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Executive Summary 


The use of accessibility features including accommodations in instruction and assessments con- 
tinues to be of great importance for students with disabilities. This importance is reflected in an 
emphasis on research to investigate the effects of accommodations. Key issues under continued 
investigation include how accommodations affect test scores, how educators and students perceive 
accommodations, and how accommodations are selected and implemented. Emerging issues across 
more recent years include how large-scale testing delivered online via various technologically- 
advanced platforms and formats have influence on accessibility features including accommoda- 
tions, and vice-versa. 


The purpose of this report is to provide an update on the state of the research on testing accom- 
modations as well as to inform future research pursuits. Previous reports by the National Center 
on Educational Outcomes (NCEO) have covered research published since 1999. We summarize 
the research to review current research trends and enhance understanding of the implications of 
accommodations use in the development of future policy directions, to highlight implementation 
of current and new accommodations, and seek to draw valid and reliable interpretations when ac- 
commodations are used in testing situations. In 2015 and 2016, 58 published research studies on the 
topic of testing accommodations were found. Among the main points of the 2015-16 research were: 


Purpose: More than 40 percent of the research was to evaluate the comparability of 
test scores when assessments were administered with and without accommodations. 
The next most common purpose was to report on perceptions and preferences about 
accommodations use. The majority of studies (about 75%) addressed multiple purposes. 


Research design: About 70% of the studies reported primary data collection on the part 
of the researchers, rather than drawing on existing (extant) data sets. About two-fifths of 
the studies involved descriptive qualitative designs, and quasi-experimental comprised 
another one-fifth of the studies. Researchers also drew on a variety of other quantitative 
and qualitative methodologies, including survey methodologies and meta-analyses. 


Types of assessments, content areas: A wide variety of instrument types were used. 
About one-fifth of the studies used academic content items drawn from specific sources 
outside of the researchers’ work, and about 16 percent of studies used state criterion- 
referenced tests. Over half of the studies used non-academic protocols or surveys devel- 
oped by the study authors. Other studies used norm-referenced measures. About one-third 
used multiple types of data. Reading and mathematics were the most common content 
areas included in the 2015-2016 research. Other content areas included science, writing, 
other language arts, and social studies. Only five percent of all studies addressed more 
than one content area in the assessments used. 


Participants: Participants were most frequently students, spanning a range of grade 
levels from K-12 to postsecondary students, although several studies included edu- 
cators as participants. Studies varied in the number of participants; some studies 
included fewer than 10 participants, whereas other studies involved tens of thousands 
of participants. 


Disability categories: Learning disabilities was the most common disability category 
of participants in the research, accounting for over half of the studies. Attention 
problems and emotional behavioral disability were the next most commonly stud- 
ied. Low-incidence disabilities were included in more than one-third of the studies. 


Accommodations: Presentation and Timing/Scheduling accommodations were the 
most frequently studied categories of accommodations. Oral delivery and extended 
time were the most-studied individual accommodations. Combinations of these two, 
and others, into aggregated sets of accommodations were also studied by several 
researchers. A relatively large number of 2015-2016 studies reported on unique ac- 
commodations. 


Findings: Empirical studies investigating performance effects of accommodations 
were not unconditionally conclusive about positive impacts on assessment scores 
for students with disabilities. Extended time mostly had no apparent influence 
on performance, and even had a negative impact for postsecondary students with 
attention-related disabilities. Oral delivery accommodations had mixed findings, 
supporting students with disabilities in one study, providing no differential benefit 
for students with disabilities compared to students without disabilities in at least 
one testing condition in another study, and had negative impacts in one study. The 
studies with findings on impacts of unique accommodations demonstrated a mix of 
impacts: three had positive effects, two had no effect, and three had negative effects 
for students with disabilities. 


Of the 11 studies addressing the impact of accommodations in reading, only two specifically 
reported positive impacts for students with disabilities. In contrast, of the findings in five 
studies of the impact of accommodations in math, the accommodation conditions benefited 
the performance of at least some students with disabilities in four studies, and had a negative 
impact for students with disabilities in one study. Many of the 2015-2016 studies were not 
focused on simple performance impacts, but provided comparisons between different versions 
of accommodations, particularly oral delivery. 


A larger proportion of studies provided findings about perceptions of accommodations than in 
previous NCEO reports, comprising nearly half of the 2015-2016 studies. Many studies pro- 


vided insights about students’ preferences among accommodations, and about specific features 
of accommodations. Seven studies’ findings explicitly indicated students’ positive perceptions 
of the usefulness and support that they gained from accommodations. Findings about educator 
perceptions were also nuanced and highlighted their recognition of their own limitations in 
understanding and providing accommodations, particularly at the postsecondary level. 


A larger proportion of studies than in previous NCEO reports investigated accommodations in 
the postsecondary education context, with over half of the studies in 2015-2016; this body of 
research yielded findings across various study purposes, including 15 studies on perceptions, 
eight studies on use patterns, five studies on performance effects; and four studies that were 
literature reviews. 
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Overview 


All students, including students with disabilities and English learners (ELs) with disabilities, 
are required by the Individuals with Disabilities Education Act (IDEA) of 2004 and by the 2015 
reauthorization of the Elementary and Secondary Education Act (ESEA) known as the Every 
Student Succeeds Act (ESSA) to participate in assessments used for accountability. Some students 
can benefit from universal features or designated features to meaningfully access assessments, 
while others need accommodations in order to demonstrate their academic knowledge and skills. 
States and assessment consortia seek clarity from research on accommodations when making 
policy decisions about accommodations. 


To synthesize accommodations research efforts completed across the years, the National Center 
on Educational Outcomes (NCEO) has published a series of reports on accommodations research. 
The time periods included 1999-2001 (Thompson, Blount, & Thurlow, 2002), 2002-2004 (John- 
stone, Altman, Thurlow, & Thompson, 2006), 2005-2006 (Zenisky & Sireci, 2007), 2007-2008 
(Cormier, Altman, Shyyan, & Thurlow, 2010), 2009-2010 (Rogers, Christian, & Thurlow, 2012), 
2011-2012 (Rogers, Lazarus, & Thurlow, 2014), and 2013-2014 (Rogers, Lazarus, & Thurlow, 
2016). This report covers the time period 2015-2016. 


The purpose of this report is to present a synthesis of the research on test accommodations 
published in 2015 and 2016. The literature described here encompasses empirical studies of 
score comparability and validity studies as well as investigations into accommodations use, 
implementation practices, and perceptions of their effectiveness. As a whole, the current research 
body offers a broad view and a deep examination of issues pertaining to assessment accommoda- 
tions. Reporting the findings of current research studies was the primary goal of this analysis. 


Review Process 


Similar to the process used in past accommodations research syntheses (Cormier et al., 2010; 
Johnstone et al., 2006; Rogers et al., 2012; Rogers et al., 2014; Rogers et al., 2016; Thompson 
et al., 2002; Zenisky & Sireci, 2007), a number of sources were accessed to complete the re- 
view of the accommodations research published in 2015 and 2016. Specifically, five research 
databases were consulted: Educational Resources Information Center (ERIC), PsycINFO, 
Academic Search Premier, Digital Dissertations, and Educational Abstracts. To help confirm 
the thoroughness of our searches, we used the Web search engine Google Scholar to search for 
additional research. In addition, a hand-search of 49 journals was completed, in efforts to ensure 
that no qualifying study was missed. A list of hand-searched journals is available on the National 
Center on Educational Outcomes website (www.nceo.info/OnlinePubs/AccommBibliography/ 
AccomStudMethods.htm). 
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Online archives of several organizations also were searched for relevant publications. These 
organizations included Behavioral Research and Teaching (BRT) at the University of Oregon 
(http://brt.uoregon.edu), the College Board Research Library http://research.collegeboard.org), 
the National Center for Research on Evaluation, Standards, and Student Testing (CRESST; 
http://www.cse.ucla.edu), and the Wisconsin Center for Educational Research (WCER; http:// 
testacc.wceruw.org/). 


The initial search was completed in December, 2016. A second search was completed in May, 
2017, to ensure that all articles published in 2015 and 2016 were found and included in this 
review. Within each of these research databases and publications archives, we used a sequence 
of search terms. Terms searched for this review were: 


e standardized (also large-scale, state, standards-based) test (also testing) changes 

e standardized (also large-scale, state, standards-based) test (also testing) modification(s) 
e standardized (also large-scale, state, standards-based) test (also testing) 

* accommodation(s) 

* test changes 

¢ test modifications 

* test accommodations 


Many of these search terms were used as delimiters when searches yielded large pools of docu- 
ments found to be irrelevant to the review. 


The research documents from these searches were then considered for inclusion in this re- 
view using several criteria. First, this analysis included only research published or defended 
(in doctoral dissertations) in 2015 and 2016. Second, the scope of the research was limited to 
investigations of accommodations for regular assessment; hence, articles specific to alternate 
assessments, accommodations for instruction or learning, and universal design in general were 
not part of this review. Third, research involving English learners (ELs) was included only if the 
target population was ELs with disabilities. Fourth, presentations from professional conferences 
were not searched or included in this review, based on the researchers’ criteria to include only 
research that would be accessible to readers and had gone through the level of peer review typi- 
cally required for publication in professional journals or through a doctoral committee review. 
(This criterion was implemented for the first time during the 2007-2008 review.) Finally, to be 
included in the online bibliography and summarized in this report, studies needed to involve 
(a) experimental manipulation of an accommodation, (b) investigation of the comparability 
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of test scores across accommodated and non-accommodated conditions, or across more than 
one accommodated condition, or (c) examination of survey results or interview data sets about 
students’ or teachers’ knowledge or perceptions of accommodations. 


To reflect the wide range of accommodations research that was conducted in 2015 and 2016, the 
studies are summarized and compared in the following ways: (a) publication type; (b) purposes 
of research; (c) research type and data collection source; (d) assessment or data collection focus; 
(e) characteristics of the independent and dependent variables under study; and (f) comparability 
of findings between studies in similar domains. 


Results 


Publication Type 


Fifty-eight studies were published between January 2015 and December 2016. As shown in 
Figure 1, of the 58 studies, 43 were journal articles, 15 were dissertations, and none were pub- 
lished professional reports released by research organizations or entities (e.g., ETS). 


The total number of studies published on accommodations in 2015-2016 (n=58) increased 
slightly from accommodations research published in 2013-2014 (n=53). The number of journal 
articles increased (n=43 in 2015-2016; n=37 in 2013-2014), and the number of dissertations 
published on accommodations was about the same (n=15 in 2015-2016; n=14 in 2013-2014). 
The number of professional reports released by research organizations or entities decreased 
(n=0 in 2015-2016; n=2 in 2013-2014). The report on accommodations research in 2013-2014 
(Rogers et al., 2016) included 37 journal articles from 27 journals; the 43 articles described in 
the current report were published in 29 journals. 


Figure 1. Percentage of Accommodations Studies by Publication Type 


Dissertations 
26% 


Reports 
0% 
Journal articles 
74% 
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Purposes of the Research 


A number of purposes were identified in the accommodations research published in 2015 and 
2016. Table 1 shows the primary focus of each of these 58 studies. Fifteen studies each listed 
a single purpose (see Appendix A). The majority of studies reviewed sought to accomplish 
multiple purposes. In those cases, we identified the “primary purpose” based on the title of the 
work or the first-mentioned purpose in the text. 


Table 1. Primary Purpose of Reviewed Research 


Purpose Number of Percent of 
Studies Studies 

Compare scores 

only students with disabilities (9 studies; 15.5% of studies) oA M% 

only students without disabilities (3 studies; 5.2% of studies) 

both students with and without disabilities (12 studies; 20.7% of studies) 
Study/compare perceptions and preferences about use 18 31% 
Report on implementation practices and accommodations use 9 16% 
Summarize research on test accommodations 6 10% 
Test development 1 2% 
Discuss issues 0 0% 
Compare test items 0 0% 
Identify predictors of need for accommodations 0 0% 
Evaluate test structure 0 0% 
Investigate test validity 0 0% 


The most common primary purpose for research published during 2015-2016 was to compare 
scores of (a) students with disabilities only, (b) students without disabilities, or (c) students with 
and without disabilities; score comparison was the central focus of 41 percent of the 58 studies 
(see Appendix A for each study’s purpose details). The next most common primary purpose 
was to investigate accommodations perceptions and preferences (31%). The third most common 
purposes was to report on accommodations use (16%). 


Reviews of research on accommodations included explorations of the research: (a) on various 
accommodations for students within specific disability categories (Barnett & Gay, 2015; Condra 
et al., 2015; Zeedyk, Tipton, & Blacher, 2016); (b) about various accommodations for students 
at a specific education level (DeLee, 2015); and (c) about a specific accommodation for stu- 
dents within a specific disability category (Cahan, Nirel, & Alkoby, 2016). In this analysis, test 
development was the central focus of a single study (Hansen, Liu, Rogat, & Hakkinen, 2016). 
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Table 2 shows the multiple purposes of many studies. Several studies had two purposes—for 
example, some studies (Lin, Childs, & Lin, 2016; Seo & De Jong, 2015) both compared scores 
of students with and without disabilities and examined item comparability. Other studies (Bouck, 
Bouck, & Hunley, 2015; Higgins et al., 2016; Rosenblum & Herzberg, 2015) included score 
comparisons of students with disabilities, while also reporting on accommodations perceptions 


and preferences. 


Table 2. All Purposes of Reviewed Research 


Number of | Percent of 

Purpose Studies Studies 
Study/compare perceptions and preferences about use 26 45% 
Summarize research on test accommodations 24 41% 
Compare scores 

only students with disabilities (8 studies; 15.5% of studies) oA M% 

only students without disabilities (3 studies; 5.2% of studies) 

both students with and without disabilities (12 studies; 20.7% of studies) 
Discuss issues 17 29% 
Report on implementation practices and accommodations use 14 24% 
Compare test items 4 T% 
Identify predictors of the need for accommodations 2 3% 
Test development 2 3% 
Evaluate test structure 1 2% 
Investigate test validity 2 3% 


Note. Because 43 studies each had more than one purpose, the study purpose numbers total more than the 58 
studies and the percents total more than 100%. 


Research Type and Data Collection Source 


Descriptive qualitative research was the most frequent design (about 40%) for the studies in 
2015-2016, which is different from previous biennial reports when quasi-experimental research 
was more common; it is unclear whether this is a trend. As displayed in Table 3, the researchers 
themselves gathered the data (1.e., primary source data) in almost three times as many descrip- 
tive qualitative studies (n=17) compared to studies with secondary data sources using extant 
or archival data (n=6). The number of descriptive qualitative research studies decreased from 
2015 to 2016. Likewise, studies using quasi-experimental research design also decreased from 
2015 to 2016, consistent with an overall decrease in studies from 2015 (n=34) to 2016 (n=24). 
Descriptive quantitative studies did not change from 2015 to 2016, with six studies in each 
year. In 2015 and 2016 researchers conducted some studies (n=8) using correlational designs, 
yet few longitudinal or meta-analytic designs. No studies used experimental designs, so that 
design was not included in Table 3. 


NCEO ) 


Table 3. Research Type and Data Collection Source by Year 


Research Design Data Collection Source Pinal 
Primary Secondary 
2015 2016 2015 2016 

Descriptive qualitative 10 7 5 1 23 
Descriptive quantitative 4 4 2 2 12 
Quasi-experimental 4 4 3 1 12 
Correlation/prediction 2 0 4 2 8 
Experimental 0 0 0 0 0 
Longitudinal 0 1 0 1 2 
Meta-Analysis 0 0 0 1 1 
Year Totals 20 16 14 8 58 
Source Totals Across Years 36 22 58 


We also observed a similarity in data collection sources between the current review period and 
previous review period. In 2015-2016, primary data were used in 36 studies (62%) and second- 
ary data were used in 22 studies (38%). This difference between data sources is smaller than 
the previous report (Rogers et al., 2016) in which over twice as many studies used primary data 
in comparison to secondary data sources. (Appendix B presents research designs and data col- 
lection sources for individual studies). 


Data Collection Methods and Instruments 


The research included in this analysis used the methods shown in Figure 2 to collect study data. 
Forty-one percent of the studies (n=24) used performance data acquired through academic con- 
tent testing. In some of the cases, tests were administered as part of the study; in other cases, 
extant data sources were used. Interviews (n=22, 38%) and surveys (n=22, 38%) were other 
common data sources, while observations and focus groups were less commonly used meth- 
ods of collecting data. Another less frequently used method was “articles.” This term refers to 
seven studies that chiefly reviewed research literature. Five studies collected various other data, 
including course grades and/or cumulative grade point averages (GPAs; Crosby, 2015; Dong & 
Lucas, 2016; Kim & Lee, 2016; Lewandowski, Wood, & Lambert, 2015), as well as disability 
documentation to validate interview data (Crosby, 2015). About one-third of the studies reported 
using more than one method or tool to gather data. The two most common combined collection 
methods were testing and surveys (n=7), and surveys and interview protocols (n=6). See Ap- 
pendix B for additional details about each study’s data collection methods. 
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Figure 2. Data Collection Methods Used in 2015-2016 Research 


Number of Studies 


Test 
Survey 
Interview Protocol 
xe] 
° 
s Articles 
= 
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Other 


Note. Of the 58 studies reviewed for this report, 18 reported using two data collection methods, and 1 reported 
using three data collection methods. Thus, the total number of studies represented in this figure total more than 
58. Other data included course grades, postsecondary GPAs, and disability documentation and other academic 
records. 


Nearly all of the 2015-2016 studies used some type of data collection instrument; only seven 
studies did not employ any instruments because they were literature reviews. Table 4 shows 
the types of data collection instruments used. Surveys presented items of an attitudinal or self- 
report nature. Tests and exams were course- or classroom-based. Assessments were statewide 
or large-scale in scope. Protocols refer to sets of questions, usually presented in an interview or 
focus group format. Measures referred to norm-referenced academic or cognitive instruments. 
All of these instruments were placed into six categories: non-academic protocols or surveys 
developed by study authors; surveys or academic tests developed by education professionals 
or drawn by researchers from other sources; state criterion-referenced academic assessments; 
norm-referenced academic achievement measures; norm-referenced cognitive ability measures; 
and other. 


Non-academic protocols developed by the author or authors of the studies—the most commonly- 
used instrument (in 57% of studies)—included performance tasks, questionnaires or surveys, 
and interview and focus-group protocols, among others. Surveys or academic tests developed 
by education professionals or researchers used sources outside of current studies, and were 
exemplified by perception surveys such as the Attitudes Toward Requesting Accommodations 
scale (ATRA; Barnard-Brak, Davis, Tate, & Sulak, 2009), and secondary analyses of datasets 
such as the National Longitudinal Transition Study-2 (NLTS2; Valdes, Godard, Williamson, 
McCracken, & Jones, 2013). 
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Table 4. Data Collection Instrument Types 


inetrumentaves Number of Percent of 
yP Studies* Studies* 

Non-academic protocols or surveys developed by study author/s 33 57% 
Surveys or academic tests developed by professionals or researchers 3 

13 22% 
using sources outside of current study 
State criterion-referenced assessments 9 16% 
Norm-referenced academic achievement measures 9 16% 
Norm-referenced cognitive ability measures 5 9% 
Other? 7 14% 
None? 7 14% 


@ Other: screening including psychological and diagnostic information (Lovett & Leja, 2015; Spiel et al., 2016; 
Weis, Dean, & Osborne, 2016); disability documentation (Crosby, 2015; Kafle, 2015); task scoring rubrics (Han- 
sen et al., 2016; Nelson & Reynolds, 2015); and course grades and/or cumulative GPAs (Kim & Lee, 2016). 


> None: 7 studies were literature reviews of studies employing various data collection approaches and/or instru- 
ments (Barnett & Gay, 2015; Cahan et al., 2016; Condra et al., 2015; DeLee, 2015; Kettler, 2015; Lane & Leven- 
thal, 2015; Zeedyk et al., 2016). 


° Twenty studies (34%) used more than one type of instrument; therefore, numbers total more than the 58 studies 
represented, and percents total more than 100. 


State criterion-referenced assessments included those of Colorado, Maine, Michigan, released 
test items from assessment consortia and several states (Higgins et al., 2016), and two large- 
scale assessments from Ontario, Canada, as well as assessments from states that remained 
unidentified in the research. Seven norm-referenced academic achievement measures were 
used in one or more studies, such as the National Assessment of Educational Progress (NAEP), 
the Nelson-Denny Reading Test (NDRT), the Wechsler Individual Achievement Test-Second 
Edition (WIAT-ID, and the Woodcock Johnson III Tests of Achievement (WJ-II]). Seven norm- 
referenced cognitive ability measures were used in one or more studies, such as the Clinical 
Evaluation of Language Functions, Fourth Edition (CELF-4); the Peabody Picture Vocabulary 
Test, Fourth Edition (PPVT-IV); the Wechsler Intelligence Scale for Children (WISC-IV); and 
the Woodcock-Johnson Tests of Cognitive Abilities IT (WJHI). About one-third of all studies 
(n=20) used instrumentation of more than one kind. We present a complete listing of the instru- 
ments used in each of the studies in Table C-1 in Appendix C, including the related studies or 
other bibliographic source information for these instruments, when available. 


Content Areas Assessed 
Many studies published during 2015-2016 focused on accommodations used in specific aca- 
demic content areas. As shown in Table 5, reading was the most commonly studied content 


area. Table 5 also provides a comparison to content area frequency found in NCEO’s previous 
analyses of accommodations research (Rogers et al., 2014, 2016). Across the years, reading and 
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mathematics have been the most common content areas for this research; however, the number 
of studies addressing reading assessments decreased in 2015-2016, and the number examin- 
ing math assessment data decreased dramatically, from previous years. The number of studies 
examining accommodation effects in more than one content area also decreased. There was 
little change across years in the number of studies addressing science, “other language arts,” 
and social studies. There was an overall decrease in the number of studies that used assessment 
data in 2015-2016 compared to 2011-2012 and 2013-2014. (See Appendix C, Table C-2, for 
additional details about the content areas.) 


Table 5. Academic Content Area Assessed Across Three Reports 


Content Area Assessed 2011-20122 | 2013-2014° | 2015-2016°¢ 
Mathematics 22 (45%) 4 (26%) 4 (7%) 
Reading 19 (39%) 16 (30%) 10 (17%) 
Writing 5 (10%) 2 (4%) 4 (7%) 
Other Language Arts? 2 (4%) 3 (6%) 3 (5%) 
Science 4 (8%) 5 (9%) 4 (7%) 
Social Studies 1 (2%) 0 (0%) 1 (2%) 
Not Specific 2 (4%) 0 (0%) 0 (0%) 
Multiple Content® 16 (33%) 9 (17%) 3 (5%) 


4 Studies in 2011-2012 included examinations of more than one content area ranging in number of areas as- 
sessed from 2 to 4. 


> Studies in 2013-2014 included examinations of more than one content area ranging in number of areas as- 
sessed from 2 to 3. 


° Studies in 2015-2016 included examinations of more than one content area comprising exactly 2 areas as- 
sessed. 


4 Detailed descriptions of what constituted “Other Language Arts” for each of the three studies from 2015-2016 
can be found in Appendix C, Table C-2. 


* Because some studies investigated effects in more than one content area, the percents total more than 100. 


Research Participants 


The studies in this analysis of 2015-2016 accommodations research included participants in 
several roles (see Figure 3 and Appendix D). In 2015-2016, a majority of the studies included 
only students—42 of the 58 studies (74%). The next largest participant group studied (14% of 
the studies) was “educators only.” This refers to studies that described or analyzed the educator 
perspective on accommodations. Both educators and students were included in one study. The 
other participant category, which was included in the report on accommodations research in 
2013-2014 (Rogers et al., 2016), was “educators, parents, and students.” None of the studies 
from 2015-2016 were in this group. Seven studies did not draw data from research participants. 


NCEO 9 


Figure 3. Types of Research Participants (n=51) 


Number of Studies 


Students only 42 


Educators only 8 


Participant Type 


Educators & Students 1 


Table 6 details the composition and size of the student participant groups in the research stud- 
ies published during 2015 and 2016. This information is displayed in more detail by study in 
Appendix D. The size of the participant groups varied from 2 (Timmerman & Mulvihill, 2015) 
to 52,484 (Seo & De Jong, 2015). The studies in 2015-2016 were mostly about student partici- 
pant samples that only had disabilities (26 studies) or did not have disabilities (5 studies). Only 
one study (Miller, Lewandowski, & Antshel, 2015) compared groups of students with an equal 
number of students with and without disabilities (n=38); only one other study (Couzens et al., 
2015) had very similar proportions of both groups in the 15 participants. In addition, the number 
of studies in which there were more students without disabilities (2=15) was lower than the 
number of studies in which there were more students with disabilities (12=27). The number of 
studies in which there were more participants without disabilities decreased (n=15) since the 
last report (Rogers et al., 2016). 


10 NCEO 


Table 6. Participant Sample Sizes and Ratio of Individuals with Disabilities 


ieee Number of Studies by Proportion of Sample Comprising 
Study Individuals with Disabilities 

0-24% | 25-49% | 50-74% | 75-100% | Unavailable | Total 
1-9 1 0 0 6 0 7 
10-24 0 1 0 6 0 
25-49 0 2 0 1 0 3 
50-99 2 1 1 0 0 4 
100-249 2 1 0 2 0 5 
249-999 1 0 0 4 0 5 
1000-4999 0 0 0 4 0 4 
5000 or more 4 1 0 2 1 8 
Unavailable 0 0 0 0 0 0 
Total 10 6 1 25 1 43 


School Level Data 


Similar to the previous report on accommodations research (Rogers et al., 2016), research during 
2015-2016 involved kindergarten through postsecondary participants (see Table 7). See Appen- 
dix D for more detail. Postsecondary refers to both university students and other participants 


in postsecondary settings. For example, Spenceley and Wheeler (2016) investigated the use of 


extended time during course exams at the postsecondary level. The largest number of studies 
published in 2015 and 2016 focused on postsecondary students (n=22; 38%), and the second 
most frequently-studied school level was middle school (n=14; 24%). The proportion of studies 
at the elementary school (n=10; 17%) and high school (n=8; 14%) levels were almost equal. 
Ten studies (17%) included students in more than one grade-level cluster—most commonly stu- 
dents from across middle school and high school (Cawthon, Leppo, Ge, & Bond, 2015; Davis, 
Orr, Kong, & Lin, 2015; Joakim, 2015; Rosenblum & Herzberg, 2015; Seo & De Jong, 2015). 


Table 7. School Level of Research Participants 


Education Level of Participants in Studies Number of Studies? | Percent of Studies? 
Elementary school (K-5) 10 17% 
Middle school (6-8) 14 24% 
High school (9-12) 8 14% 
Postsecondary 22 38% 
No age 8 14% 
Not applicable 7 12% 


4 Ten studies (17%) had participants in more than one education level; therefore, the numbers total more than the 
58 studies represented, and percents total more than 100. 
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Disability Categories 


The accommodations research in 2015-2016 addressed a broad range of disability categories 
(see Appendix D for details). As shown in Table 8, four studies did not specify any disability 
categories for the student participants, and 14 studies did not include students in the sample. Of 
the remaining 40 studies, the most commonly studied student disability category was learning 
disabilities (n=30); five of these studies had only participants with learning disabilities, and four 
more compared students with learning disabilities to students without disabilities. 


About one-third of the studies included students with attentional difficulties (n=20). The rel- 
evant studies also included students with emotional behavioral disabilities (n=15), students 
with “multiple disabilities” (n=13), students with physical disabilities (2=12), students with 
autism-related disabilities (a=11), and students with blindness or visual disabilities (n=9). About 
one-tenth included students with deafness or hearing impairments (n=6), students with speech/ 
language impairments (n=6), or students with intellectual disabilities (n=5). No studies specifi- 
cally mentioned students with traumatic brain injuries. A little over one-fourth of these studies 
included students without disabilities as comparison groups (n=15). Except for studies that 
addressed accommodations and students with learning disabilities, very few studies examined 
accommodations for only participants with one specific category of disability. 


Table 8. Disabilities Reported for Research Participants 


Disabilities of Research Participants Number of Studies? | Percent of Studies? 
Learning disabilities 30 52% 
Attention problem 20 34% 
Emotional behavioral disability 15 26% 
Multiple disabilities 13 22% 
Physical disability 12 21% 
Autism 11 19% 
Blindness/Visual impairment 9 16% 
Deafness/Hearing impairment 6 10% 
Speech/Language 6 10% 
Intellectual disabilities 5 9% 
Traumatic brain injury 0 0% 
No disability 15 26% 
Not specified 4 T% 
Not applicable 14 24% 


@ Several studies had participants who fell into various disability categories; therefore, the numbers in this figure 
total more than the 58 studies represented, and percents total more than 100. 
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Types of Accommodations 


The number of times specific categories of accommodations were included in 2015-2016 pub- 
lished research is summarized in Table 9. Presentation and timing/scheduling accommodations 
were the most frequently studied categories, each with 22 studies. Within the presentation ac- 
commodations category, the most common accommodation was oral delivery/read aloud—in- 
cluding human reader and various technology approaches (e.g., text-to-speech). Extended time 
was examined in all 22 of the studies that included the scheduling accommodations category. 
Several studies (n = 25) analyzed accommodations from more than one category. Of those, three 
studies (Cawthon et al., 2015; Kettler, 2015; Lin & Lin, 2016) included accommodations from 
each of the five accommodations categories. A complete listing of accommodations examined 
in each study is provided in Appendix E (Tables E-1 through E-5). 


Table 9. Accommodations in Reviewed Research 


Accommodations Number of 
Category Studies? 
Presentation 22 
Equipment/Materials 13 
Response 14 
Timing/Scheduling 22 
Setting 21 


@ Several studies investigated accommodations that fit into more than one category; therefore, the numbers in 
this figure total more than the 58 studies represented 


Research Findings 


The findings of the studies on accommodations published in 2015 and 2016 are summarized 
according to the nature of the studies. These findings were consistent with their various stated 
purposes and focuses. The findings included sets of research about specific accommodations: 
oral delivery, extended-time, separate setting, and aggregated sets of accommodations commonly 
called “bundles.” We also report the findings on impact of unique accommodations—those 
examined in only one study—including familiar administrator, pacing support, signed admin- 
istration, tactile graphics, calculator, marking answers in test booklet, word processing, taking 
breaks during testing, individual administration, and small group administration. We report on 
accounts of perceptions about accommodations, including those of student test-takers as well as 
educators. We summarize the findings of the accommodations, and describe a range of imple- 
mentation conditions as well as incidence of use of various accommodations across large data 
sets. The findings from studies in postsecondary educational contexts, which have grown over 
time from 6 to 15 in past reports, to 30 studies in this report, are given separate attention. This 
report also presents findings by academic content areas: math, reading, science, social studies, 
and writing. In Appendix F, we provide substantial detail about individual studies. 
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Impact of Accommodations 


Research examining the effects of accommodations on assessment performance for students with 
disabilities comprised 23 studies published in 2015 and 2016 (see Figure 4; see also Appendix 
F for details about each study of this type). We report the effects of these four discrete accom- 
modations—extended time, oral delivery, computer administration, and separate/specialized 
setting—along with a list of aggregated accommodations and uncommon accommodations. 


Figure 4. Effects of Specific Accommodations (n=23) 


Extended time 

Oral delivery 

Computer administration 
Specialized setting 


Aggregated set 


Breaks 

Calculator 

Familiar administrator 
Individual 


Mark answer in test booklet 


Specific Accommodations 


Pacing support 
Signed administration 
Small group 


Tactile graphics 


SN ee ee ee ee ee ee ee 


Word processor 
Number of Studies 


Note. Four studies examined the separate impacts of several accommodations; one study examined the effects 
of accommodations in general, but did not specify comparisons of individual accommodations with one another; 
one study reported findings on the impact of modifications as well as an accommodation (extended time). 


The most investigated accommodation in 2015-2016 was extended time—provided either as 1.5 
or 2 times the standard time provided for testing, unlimited time, or unspecified extended time 
amount—which was investigated in six studies. Students in grades K through 12 (Cahan et al., 
2016; Joakim, 2015; Ohleyer, 2016; Siidkamp, Pohl, & Weinert, 2015) and postsecondary stu- 
dents (Lovett & Leja, 2015; Miller et al., 2015) were engaged in investigations about the impact 
of this accommodation on academic performance. Four studies (Cahan et al., 2016; Stidkamp et 
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al., 2015; Lovett & Leja, 2015; Miller et al., 2015) compared the performance of students with 
specific disabilities and their peers without disabilities. In contrast, Joakim (2015) examined a 
large extant data set of students with various disabilities, and discerned the separate impacts of 
a number of different accommodations, including extended time. Ohleyer (2016) analyzed data 
longitudinally for students with learning disabilities only. In sum, five studies provided findings 
about the impact of extended time on students’ performance in either reading (Lovett & Leja, 
2015; Miller et al., 2015; Sitidkamp et al., 2015), or in writing (Joakim, 2015; Ohleyer, 2016); 
in addition, there was a separate meta-analysis (Cahan et al., 2016) of the impact of extended 
time on assessment performance in various academic content areas. 


For the studies with students at the K-12 level, extended time did not affect writing score re- 
sults for students with various disabilities in grades 5 and 8 (Joakim, 2015) or for students with 
learning disabilities in grades 4, 5, and 6 (Ohleyer, 2016). Grade 5 students with disabilities 
completed more items when presented with fewer test items in the same time period (Siidkamp 
et al., 2015). However, differential item functioning analysis yielded that the impact of extended 
time was complicated by potential validity concerns; that is, several items functioned signifi- 
cantly differently for students with disabilities on all test versions, while there were no items of 
concern for low-performing students without disabilities. Examining impact of extended time on 
17 tests in 11 studies, Cahan and colleagues (2016) concluded that there was a low correlation 
between gain scores and students’ learning disability status for most of the studies. Further, they 
argued that some students without disabilities benefited from extended time, and indicated that 
non-timed tests would be a better approach so that students needing additional time, whether 
having disabilities or not, could have access to it. 


For postsecondary students with disabilities, there were more complex and mixed findings. 
Lovett and Leja (2015) found that extended time also did not affect reading results across all 
postsecondary students with attentional or executive functioning difficulties, and that postsec- 
ondary students with more ADHD symptoms or more executive functioning difficulties showed 
significantly less benefit from extended time. Miller and colleagues (2015) indicated that students 
with attentional difficulties performed similarly—in terms of attempting similar numbers of items 
and scoring correctly on similar numbers of items—as one another within each testing time 
condition. Further, both students with and without disabilities performed worse with standard 
time, better with 150% time, and best with 200% time (Miller et al., 2015). 


Four studies (Kim, 2016; McMahon, Wright, Cihak, Moore, & Lamb, 2016; Ohleyer, 2016; Ricci, 
2015) provided findings about the oral delivery accommodation. For clarity in this report, as in 
previous reports (Rogers et al., 2014; Rogers et al., 2016), we used the term “oral delivery” to 
encompass in-person read-aloud as well as voice recordings and text-reading software or text- 
to-speech devices. Two studies (Kim, 2016; Ohleyer, 2016) reported on the impact of in-person 
oral delivery (“read-aloud’’) and directions only read aloud, and three studies reported on the 


NCEO 15 


impact of voice recording (Kim, 2016; McMahon et al., 2016) or text-to-speech tools (Ricci, 
2015). Indeed, a focus of two of these studies was comparing the impact of human voice, live 
versus recorded (Kim, 2016), or directions only or entire test read aloud versus assistive technol- 
ogy (AT) communication device (Ohleyer, 2016). To be clear, Ohleyer (2016) compared writing 
assessment performance between common accommodations—extended time, directions (only) 
read aloud, oral script, and no accommodation—and assistive technology communication device, 
in terms of the manner by which the test-takers communicated their responses for the writing 
assessment, including but not limited to a speech-to-text device due to a coding complication. 
Two studies (Kim, 2016; McMahon et al., 2016) had comparison groups of students without 
disabilities, while one study (Ohleyer, 2016) engaged only students with learning disabilities 
across grade levels, and Ricci (2015) completed a post hoc data analysis for students with vari- 
ous disabilities using oral delivery versus other accommodations in general. All four studies 
included students in grades between kindergarten and grade 6. Two studies (Kim, 2016; Ricci, 
2015) examined the impact of oral delivery on reading test performance, noting that directions 
and items were delivered orally, but that reading passage text segments were not. 


Kim (2016) found that kindergarten and grade 2 students scored better in comprehension with 
in-person versus recorded oral delivery, and grade 4 students scored the same in comprehen- 
sion in both oral delivery conditions; also, students in all grade levels had retell quality scores 
that were essentially the same with in-person versus recorded oral delivery. McMahon and 
colleagues (2016) found that all grade 6 students scored significantly better in the oral delivery 
conditions than without accommodations, yet they did not score differently between the in- 
person and video podcast-delivered science assessment. Mean score comparisons of students 
with disabilities versus students with reading difficulties (but without disabilities) indicated that 
students without disabilities scored significantly higher in the unaccommodated and in-person 
oral delivery conditions than their peers with disabilities, yet not significantly higher when 
completing the podcast-delivered science test. Ohleyer (2016) found that students with learning 
disabilities in grades 4, 5, and 6 performed better on writing assessments when using read-aloud 
directions only and when using assistive technology versus using no accommodations, and 
scored not significantly differently when receiving oral delivery of the complete assessment. 
Further, students who used assistive technology across more than one year scored significantly 
better than those who had not. Ricci (2015) found that grade 4 students with disabilities who 
received text-to-speech delivered by computer scored lower in reading comprehension than 
students with disabilities receiving other accommodations but not text-to-speech; effect sizes 
in the three states ranged from medium to very large. 


Two studies (Eberhart, 2015; Seo & De Jong, 2015) investigated impacts of computer-admin- 
istered testing, analyzing population data from all students (both with and without disabilities) 
together to detect possible different effects based on assessment format. Seo and De Jong (2015) 
compared traditional paper-based grade 6 and 9 social studies testing to the tests presented via 
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computer, finding no significant differences in scores by these testing formats. Eberhart (2015) 
compared performance on grade 7 math and language arts assessments, when administered on 
computers and on tablets; also, she compared items with technological enhancements to tradi- 
tional multiple-choice items. The findings were complex: on average, students scored statistically 
higher on computer than on tablet; further, students answered multiple-choice questions more 
successfully on computer than tablet, but there were no significant performance differences by 
device for the technologically-enhanced items. 


Two studies examined the impact of the separate setting accommodation (Lewandowski et al., 
2016; Lin et al., 2016). The findings were generally consistent with one another. Lewandowski and 
colleagues (2016) reported that students without disabilities scored significantly better in reading 
with the standard group setting rather than the separate individual setting. Lin and colleagues 
(2016), in their post-hoc analysis study comparing scores of students with learning disabilities 
and students without disabilities—with some of each student group taking the test in a standard 
classroom setting and some completing it in a separate setting—found that students with dis- 
abilities using the setting accommodation had the lowest group mean scores, non-accommodated 
students with disabilities had the next-lowest mean scores, and the non-accommodated students 
without disabilities scored highest, higher than accommodated students without disabilities. 
Further, applying multilevel measurement modeling, Lin and colleagues found no individual 
item effects for the two groups of students with disabilities, and non-accommodated students 
with LD evidenced lower item difficulty than accommodated students with LD. 


Four studies (Giusto, 2015; Lin & Lin, 2016; Rudzki, 2015; Spiel et al., 2016) reported the 
impact of aggregated sets, or bundles, of accommodations. Mentioned previously as reporting 
impact findings for pacing-only support, Giusto (2015) also compared the impact of both oral 
delivery and pacing guidance by the test administrator, finding that this combination of supports 
benefited students with reading disabilities more than the pacing-only and unaccommodated 
testing conditions. In contrast, students without disabilities did not score significantly differently 
across these conditions. Lin and Lin (2016) analyzed literacy test data using an odds ratio ap- 
proach, and found that the groups of students with disabilities who naturalistically received—in 
accordance to their [IEPs—combinations of certain accommodations performed better than 
students with disabilities receiving either other accommodations or no accommodations. The 
bundles included computer administration along with extended time, or specialized setting, or 
both extended time and specialized setting. Students with learning disabilities benefited most 
from these three sets of accommodations. Rudzki (2015) found that elementary and middle 
school students with reading disabilities naturalistically using combinations of extended time, 
small group administration, and separate setting did not differentially benefit from these accom- 
modation sets; in fact, she noted that none of the students’ scores were at the proficient level. 
Spiel and colleagues (2016) indicated that in-person oral delivery and small group together 
benefited the mean science score of students with attention-related disabilities, in comparison 
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to the unaccommodated test condition; also, individual student data analyses indicated that only 
one student with attentional difficulties scored higher without accommodations. In comparison, 
individual students without attention-related disabilities had mixed results: about half of them 
benefited from the accommodated condition, and the other half scored lower with the accommo- 
dation set than without it. Further analyses to detect differential accommodation benefit yielded 
that students—both with and without ADHD—who tended to score low in science benefited 
from this aggregated set in comparison to students with average or above scores; students with 
ADHD did not differentially benefit from oral delivery in small groups. 


We identified separate reportable findings on the impact of 10 unique accommodations—that 
is, accommodations that were the focus of just one study during the two years included in this 
report. These unique accommodations yielded a variety of effects results. In one study (Joakim, 
2015) reporting separate effects for several unique accommodations, no specific accommoda- 
tion—such as breaks—benefited either grade 5 or grade 8 students with disabilities, and some 
student groups scored higher in writing without specific accommodations—such as familiar 
administrator, individual, and small group—than when using them. 


Two other unique accommodations benefited students with disabilities, both in terms of their 
completing more test items and in answering more test items correctly. Bouck and colleagues 
(2015) found that middle school students with various disabilities performed better on math 
computation and word problems when using a graphing calculator accommodation; grade 7 
students had a small effect, and grade 8 students had a small to moderate effect. Potter, Lewan- 
dowski, and Spenceley (2016) reported that postsecondary students with learning disabilities or 
attention-related disabilities, or both, performed better on reading testing when marking their 
answers in test booklets than when answering on separate bubble-sheets. Another study (Hig- 
gins et al., 2016), comparing math performance with and without American Sign Language 
(ASL) accommodations, yielded that students who were deaf scored on average consistently and 
significantly higher when using the accommodations, at elementary, middle, and high school 
levels. Closer analyses of student performance in the items comparing differing ASL condi- 
tions (such as finger-spelled only vs. finger-spelled and signed) indicated non-significant score 
differences; that is, the ways that ASL was presented were less impactful. In the pacing-only 
support, Giusto (2015) reported on the comparative impact of the test administrator providing 
guidance throughout the assessment sections, but without also reading the test aloud. When 
only receiving pacing support, students with reading-related disability scored very similarly to 
not receiving accommodations, and students without disabilities scored no differently across 
all the accommodated and non-accommodated conditions. 


In summary, of the 10 unique accommodations, three indicated benefits for at least some stu- 
dents with disabilities, two indicated no benefits for students with disabilities, and three indi- 
cated negative impacts for students with disabilities. The remaining studies (Davis et al., 2015; 
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Rosenblum & Herzberg, 2015) on unique accommodations compared versions of accommodated 
conditions only, not including an unaccommodated condition. Davis and colleagues (2015) 
indicated that students without disabilities (only) performed no differently when composing 
writing test answers by typing on an external keyboard with a laptop computer versus a touch- 
screen keyboard on an electronic tablet. Examining the impact of four different tactile graphics 
conditions of information for math and science test items for students with visual impairments, 
Rosenblum and Herzberg (2015) found complex impacts, noting that there were some better 
tactile formats for students to answer correctly. For instance, the largest number of middle and 
high school participants answered correctly when using the microcapsule map, and the fewest 
answered correctly when seeking information from a collage picture using hot glue and braille 
labels; also, an embossed bar graph was confusing such that at least some students could not 
answer questions, unrelated to the items’ difficulty level. 


Perceptions about Accommodations 


Figure 5 displays the data for the 26 studies on perceptions about accommodations. More than 
two-thirds of them (n=19) provided findings about student perceptions only, while less than 
one-quarter (n=6) provided findings about educator perceptions only, and two studies (Couzens 
et al., 2015; Crosby, 2015) reported on accommodations perceptions from both students and 
educators. 


Figure 5. Accommodations Perceptions (n=27) 
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In seven of the 19 studies on student perceptions (only), researchers found that students had 
favorable impressions about specific accommodations—such as speech recognition tools (Nelson 
& Reynolds, 2015; Weis et al., 2016), and tactile graphics (Hansen et al., 2016)—or accom- 
modations overall (Kafle, 2015; Ruhkamp, 2015; Timmerman & Mulvihill, 2015; Williams, 
2015). Students preferred online testing (70%) over paper-based testing (10%), with 20% of 
students having no preference (Seo & De Jong, 2015). Six studies yielded students’ preferences 
related to the features of accommodations (Davis et al., 2015; Eberhart, 2015; Hansen et al., 
2016; Higgins et al., 2016; Rosenblum & Herzberg, 2015; Williams, 2015). One of these studies 
(Rosenblum & Herzberg, 2015) found that nearly all participants indicated that they were not 
asked by educators for their input on the design of tactile graphics. 


In five of the 19 studies, the connections between students’ perceptions and their use of ac- 
commodations were reported. Students in Cole and Cawthon’s (2015) study were less likely to 
disclose about their disabilities and seek accommodations when they had more negative views 
about seeking accommodations and more negative associations with their disabilities. These 
findings were corroborated by other researchers who found that students were less likely to seek 
accommodations when they had feelings of guilt and shame around seeking accommodations 
(Ruhkamp, 2015) and doubts about the quality and usefulness of disability services offices (Ly- 
man et al., 2016). On the other hand, Monagle (2015) found that students were more willing to 
use accommodations when they had more positive attitudes toward them. 


Researchers also reported on students’ reasons for seeking accommodations (Ofiesh, Moniz, 
& Bisagno, 2015; Ruhkamp, 2015). Two studies uncovered postsecondary students’ views of 
how staff members might perceive accommodations and students with disabilities. In the study 
by Yssel, Pak, and Beilke (2016), students reported they perceived that faculty members—even 
those who students perceived were unfamiliar with certain disabilities—were positive and willing 
to provide accommodations. In contrast, students in Zambrano’s (2016) study shared that they 
perceived that faculty members had limited understanding of students with disabilities, which 
contributed to insufficient institutional communication about accessibility and accommodations 
information. Last, Lovett and Leja (2015) found that students with more difficulties related to 
ADHD or executive functioning perceived that they needed extended time to a significant degree. 


Findings from the six studies on educator perceptions (only) pertained to training and pre- 
paredness related to accommodations and their attitudes toward accommodations. First, five 
of the six studies provided educators’ comments about preparedness (Ajuwon, Meeks, Griffin- 
Shirley, & Okungu, 2016; DePountis, Pogrund, Griffin-Shirley, & Lan, 2015; Detrick-Grove, 
2016; Gallego & Busch, 2015; Sokal, 2016). Educators in these studies reported that they felt 
that staff needed more access to assistive technology training (Ajuwon et al., 2016; Gallego & 
Busch, 2015) and that their employers prepared them to provide accommodations for students 
with disabilities more than their academic training programs (Detrick-Grove, 2016). Research- 
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ers of two studies highlighted educators’ own assistive technology proficiency (Ajuwon et al., 
2016; DePountis et al., 2015). 


In three of the six studies, researchers examined educators’ attitudes toward accommodations. 
Two studies indicated that educators had positive attitudes toward accommodations, and that 
teachers tended to report that low-tech accommodations—such as reading directions and read- 
ing test questions out loud—were more beneficial for students than more high-tech options 
(Detrick-Grove, 2016; DePountis et al., 2015). Professors and disability services personnel in 
Sokal’s (2016) study had different feelings about accommodations for students with anxiety 
disorders, demonstrating the tension between accommodating the needs of students and sup- 
porting the development of students’ coping skills. In the last study (Lawing, 2015), teachers 
identified important classroom-level factors that influence the identification of instructional 
accommodations, which may apply to assessment accommodations as well. Teachers’ most 
common answers included students’ present levels of functioning, evidence of successful accom- 
modations, and the subject matter being taught or tested. Lawing (2015) also stated ““Teachers 
with the most positive attitude toward inclusion used a systematic approach to accommodation 
selection” (p. 175). 


Researchers investigated the perceptions of both students and educators in two studies. In the 
first study (Couzens et al., 2015), student participants reported various degrees of value about 
the writing supports available, with some indicating that these were very valuable and others 
indicating that they were not. Most students also shared that they have not used disability service 
supports “because they perceived [the services] to be for students with greater needs” (Couzens 
etal., 2015, p. 35). University personnel participants in this study commented that many students 
who could benefit from supportive services had not sought them and that staff would have to 
encourage students to do so. Staff members also noted that resources were not always available 
for students to explore potentially helpful assistive technologies with which they were not already 
familiar. In the second study, Crosby (2015) interviewed postsecondary faculty and students 
about their institution’s social context and culture regarding inclusion practices and perceptions 
of disability. The researcher remarked that faculty members demonstrated in their responses 
some misconceptions about disability, particularly around the likelihood of student success and 
knowledge about laws and policies about accommodating students. Additionally, about 15% of 
faculty members reported that they were uncomfortable teaching students with disabilities. The 
postsecondary students with disabilities in this study indicated that the challenges they faced 
were influenced by the relevance of their disabilities to their identities, in that self-perceptions 
of normality or abnormality were associated with their degrees of willingness to disclose their 
needs for academic assistance. Furthermore, when viewing disability as a negative attribute, 
students tended to mentally calculate the balance of the social costs of their having disabilities 
with the benefits of accessing academic supports. The researcher offered some suggestions for 
supporting students with disabilities in postsecondary education. 
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Implementation and Use of Accommodations 


The researchers from 14 studies reported findings related to accommodations use, as well as 
implementation issues. In twelve studies (Barnhill, 2016; Cawthon et al., 2015; Davis et al., 
2015; DePountis et al., 2015; Kim & Lee, 2016; Monagle, 2015; Newman & Madaus, 2015a; 
Newman & Madaus, 2015b; Ohleyer, 2016; Ricci, 2015; Spenceley & Wheeler, 2016; Weis et 
al., 2016), researchers described patterns of accommodations use. Of those, four studies (Davis 
et al., 2015; DePountis et al., 2015; Ohleyer, 2016; Ricci, 2015) reported on accommodations 
use at the primary and secondary levels; the remaining nine studies pertained to accommodations 
use at the postsecondary level. Two studies (Lawing, 2015; Peterson, 2016) did not yield use 
patterns, yet the researchers provided details about implementation processes and difficulties, 
and offered insights about decision-making matters; Lawing (2015) investigated these matters 
in K-12 education, and Peterson (2016) studied implementation in the postsecondary setting. 
Lawing concluded that teachers with favorable attitudes toward inclusion were more systematic 
in their approach, and that accommodations selection did not appear to be influenced by stu- 
dents’ future postsecondary activities. Peterson found that postsecondary personnel indicated 
students often did not have opportunity to explore available supports and consequently, did not 
seek them out. 


Accommodations use patterns were reported for specific accommodations during large-scale 
assessments in grades 3 through 12. Middle and high school students used keyboards and 
handwriting on paper for writing tests interchangeably and with similar frequency, and typi- 
cally did not use tablets with touchscreens at school, more commonly using laptop computers 
with standard keyboards (Davis et al., 2015). Educators of high school students who were blind 
reported on many electronic assistive technology devices and software used during math assess- 
ments, including various calculators with speech-to-text capabilities, braillewriters, refreshable 
braille displays, and physical manipulative tools (DePountis et al., 2015). Extant data sets of 
grade 4 students provided information about incidence of text-to-speech oral delivery of read- 
ing assessments (Ricci, 2015). 


Researchers related information about accommodations use patterns at the postsecondary level 
(Barnhill, 2016; Kim & Lee, 2016; Monagle, 2015; Newman & Madaus, 2015a; Newman & 
Madaus, 2015b; Spenceley & Wheeler, 2016; Weis et al., 2016). Extended time accommodations 
use patterns were described in five studies (Barnhill, 2016; Cawthon et al., 2015; Kim & Lee, 
2016; Spenceley & Wheeler, 2016; Weis et al., 2016); three of these studies also presented data 
on use of separate setting (Barnhill, 2016; Kim & Lee, 2016; Weis et al, 2016). Extended time 
and separate exam site were the most common accommodations reported throughout these stud- 
ies. For example, Kim and Lee (2016) indicated that 75% of students with disabilities requested 
extended time, and Weis and colleagues (2016) reported that 27 percent of students with learning 
disabilities completed their exams in a separate room. Spenceley and Wheeler (2016) reported 
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that many students with various disabilities requested extended exam time, yet that about 55 
percent did not end up using the additional time. They distinguished the disability categories 
of the students who typically used extended time: students with ADHD, autism, physical, and 
multiple disabilities. Weis et al. also indicated accommodations use patterns for several other 
accommodations, including taking breaks during exams (less than 10% of participants), and 
using technological aids (70% of participants)—including calculator, word processor, spell 
checker, speech-to-text, text-to-speech, reader, dictionary or thesaurus, outlining, and breaks. 
Three studies previously cited also provided findings detailing use patterns according to stu- 
dents’ disability categories: autism/Asperger Syndrome (Barnhill, 2016); hearing impairments 
(Cawthon et al., 2015); and visual, medical, learning, ADHD, autism, and multiple disabilities 
(Weis et al., 2016), and all of these disability types (Spenceley & Wheeler, 2016). 


Two studies’ findings detailed patterns of unspecified accommodations (Monagle, 2015; New- 
man & Madaus, 2015a). Monagle (2015) found that various factors were associated with varying 
numbers of accommodations used: students most likely to use accommodations included those 
in their second or third year of college, those with multiple disabilities, those with majors in 
the liberal arts or humanities areas, and those with positive attitudes toward accommodations. 
Newman and Madaus (2015a; 2015b) reported incidence of accommodations use among vari- 
ous types of postsecondary programs, as well as differences by disability categories. These 
researchers calculated odds ratios and found that students in two-year and career and technical 
programs whose transition plans specified accommodations needed in postsecondary educa- 
tion were more likely to receive them. Students with apparent and observable disabilities more 
commonly received accommodations than students with less-visible disabilities, particularly at 
two-year and four-year institutions. (See Appendix F for more detailed explanation of findings 
of each study.) 


Validity 


The topic of validity was addressed in the findings of four studies (Kettler, 2015; Lane & 
Leventhal, 2015; Potter et al., 2016; Siidkamp et al., 2015). Two studies (Potter et al., 2016; 
Siidkamp et al., 2015) included in their stated research purposes the analyses of construct 
validity for the assessments at the center of their investigations. Potter and colleagues (2016) 
reported findings about whether the response format—that is, answering items in a test booklet 
versus on a separate bubble sheet—affected the construct validity of the reading test. These 
researchers indicated that there was no differential benefit for students with disabilities using 
this response accommodation, and that students without disabilities also preferred answering 
in the test booklet. Further, they reported that the scores in the different response formats were 
significantly different from one another for the students with and without disabilities. Specifi- 
cally, students with disabilities answering in test booklets scored higher as a group than students 
without disabilities answering in the bubble sheet format, concluding that it is not certain that 
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this response format change did not affect the test construct. They argued in favor of course 
exams being provided for all students to circle their answers in test booklets. Sitidkamp and col- 
leagues (2015) reported on comparisons of student scores on two other versions of a reading 
literacy test, as well as the standard version. They used a differential item functioning analysis 
and found that low-performing students without disabilities did not evidence any unusual scoring 
patterns; however, for scores of students with disabilities, they found variances in several items, 
suggesting construct-irrelevant variance. They concluded that the changes to the test introduced 
problems in test fairness for all students. 


Two literature reviews (Kettler, 2015; Lane & Leventhal, 2015) offered findings that provide 
insight into the validity of academic assessments as influenced or not influenced by accommo- 
dations. Examining 30 studies’ findings for oral delivery, 24 studies for extended time, and 15 
for aggregated sets of accommodations, Kettler (2015) highlighted findings about accommoda- 
tions’ validity concerns. He noted that four of the 30 studies indicated that oral delivery did not 
invalidate tested content, including that only a few items on one reading comprehension test 
were affected by oral delivery. He also mentioned that one of the 15 studies on accommodations 
bundles analyzed factor structures and indicated that the IEP-developed set of accommodations 
did not invalidate the ELA test construct, yet cautioned that accommodations within sets might 
have unexpected interactions with one another. Lane and Leventhal (2015) examined 11 stud- 
ies for the possibility of accommodations’ differential boost for students with disabilities, and 
reported evidence from four studies. They discussed construct-irrelevant variance and described 
the application of differential item functioning and other analysis procedures to ascertain whether 
accommodations have different effects than intended based on student characteristics. These 
researchers also discussed studies using designs such as factor analyses to examine internal test 
structure. (See Appendix F for more detailed explanation of findings of each study.) 


Accommodations in Postsecondary Education 


Thirty studies reported findings about accommodations at the postsecondary education level. 
Researchers reported findings on students with disabilities’ perceptions, preferences, and experi- 
ences using accommodations at the postsecondary level (from 13 studies); educators’ percep- 
tions about accommodations (from 3 studies); accommodation use patterns (from 8 studies); 
effects of accommodations on test performance (from 4 studies); three studies each reported 
findings in two of these areas. Four studies were literature reviews describing accommodations 
issues in postsecondary education, including one study (Cahan et al., 2016) that also reviewed 
research at the K-12 level. Of the 26 studies that were not literature reviews, 21 reported find- 
ings involving only student participants, four studies involved only educator participants, and 
one study (Crosby, 2015) had participants who were students and educators. 
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Fifteen studies provided findings on perceptions in postsecondary education; 12 reported only 
on students’ perceptions, while two reported only on educators’ perceptions. One study (Crosby, 
2015) reported on the perceptions of both students and educators. The findings of the 12 studies 
(Cole & Cawthon, 2015; Couzens et al., 2015; Kafle, 2015; Lovett & Leja, 2015; Lyman et al., 
2016; Monagle, 2015; Nelson & Reynolds, 2015; Ofiesh et al., 2015; Ruhkamp, 2015; Timmer- 
man & Mulvihill, 2015; Yssel et al., 2016; Zambrano, 2016) provided insights about students’ 
experiences with and outlooks about accommodations. In several studies, researchers’ qualitative 
data through interviews (Cole & Cawthon, 2015; Couzens et al., 2015; Kafle, 2015; Lyman et 
al., 2016; Nelson & Reynolds, 2015; Ofiesh et al., 2015; Timmerman & Mulvihill, 2015; Ys- 
sel et al., 2016; Zambrano, 2016) or quantitative data through surveys (Lovett & Leja, 2015; 
Monagle, 2015; Ruhkamp, 2015) provided insights about students’ accessing accommodations. 
The researchers described various factors, including students’ perspectives about themselves as 
learners, and these factors’ influence on students’ decisions to seek or not seek accommodations 
for use during course exams. Students lacked familiarity with the process of seeking accom- 
modations at postsecondary institutions, including disability services and resources (Cole & 
Cawthon, 2016; Kafle, 2015; Lyman et al., 2016). Students reported their self-consciousness 
about receiving accommodations due to concerns about reactions of their peers without dis- 
abilities (Cole & Cawthon, 2015; Kafle, 2015; Lyman et al., 2016; Timmerman & Mulvihill, 
2015), yet also recognized that their peers without disabilities might lack understanding about 
their challenges (Zambrano, 2016). Students were also concerned about whether their profes- 
sors will be understanding about students’ challenges (Cole & Cawthon, 2015; Kafle, 2015; 
Lyman et al., 2016; Zambrano, 2016), yet students also indicated that professors were positive 
and willing to provide accommodations (Yssel et al., 2016). Another factor highlighted by some 
researchers was students’ self-determination and self-advocacy development (Cole & Cawthon, 
2015; Yssel et al., 2016). Students also faced their own desires for self-sufficiency, hoping not 
to need accommodations at the postsecondary level (Lyman et al., 2016), and also did not seek 
support due to a sense that they did not need them as much as other students with more challeng- 
ing disabilities (Couzens et al., 2015). Some studies described students’ perceptions of specific 
accommodations, such as speech recognition tools for writing (Nelson & Reynolds, 2015). 
Ruhkamp (2015) relayed students’ experiences about benefiting from exam accommodations, 
including gaining a better understanding of exam items and improved performance, as well as 
increased confidence and comfort, and a decreased sense of pressure. Monagle (2015) described 
the link between students’ perceptions of and attitudes about accommodations and their actu- 
ally using accommodations, and reported on demographic and other factors’ associations with 
accommodations use. Educators’ perceptions were reported in two studies (Gallego & Busch, 
2015; Sokal, 2016). Gallego and Busch (2015) described the perceptions of accommodations 
from disability services office personnel who primarily valued the supports that they could 
provide yet also sensed that foreign language program directors and their teaching assistants 
lacked substantial information about accommodations available to students with disabilities. 
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After interviewing professors and disability services office personnel, Sokal (2016) described 
an essential tension between accommodating students’ needs and supporting the development 
of students’ coping skills, reflected in professors’ concerns about fairness and the philosophy 
about educational access from disability services offices. 


Seven studies (Barnhill, 2016; Kim & Lee, 2016; Monagle, 2015; Newman & Madaus, 2015a; 
Newman & Madaus, 2015b; Spenceley & Wheeler, 2016; Weis et al., 2016) reported on accom- 
modation use patterns by postsecondary students. One study (Peterson, 2016) yielded details 
about implementation processes and difficulties in several postsecondary institutions, reported 
by disability services professionals. The researcher related resource challenges and uneven fa- 
miliarity at the postsecondary level about accommodations in general, noting no specific accom- 
modations. All of these studies indicated only use or implementation findings. Accommodations 
use patterns were reported according to specific accommodations (Kim & Lee, 2016; Spenceley 
& Wheeler, 2016; Weis et al., 2016), and they all provided disability category data as well. All 
three studies reported on extended time use, two studies reported on separate setting use (Kim 
& Lee, 2016; Weis et al., 2016), and one study reported on oral delivery use (Kim & Lee, 2016). 
The other four studies (Barnhill, 2016; Monagle, 2015; Newman & Madaus, 2015a; Newman 
& Madaus, 2015b) presented findings in a different manner. Barnhill (2016) indicated that 29 
of the 30 postsecondary institutions where participants were enrolled provided extended time 
and separate setting accommodations for students with autism spectrum-related disabilities, and 
some combined one or both of these with oral delivery. As mentioned in the “Implementation 
and Use” findings, two studies did not provide specific accommodation details (Monagle, 2015; 
Newman & Madaus, 2015a). 


In five studies (Dong & Lucas, 2016; Lewandowski et al., 2015; Lovett & Leja, 2015; Miller et 
al., 2015; Potter et al., 2016), researchers examined the impact of accommodations on student 
performance. Two studies (Lovett & Leja, 2015; Miller et al., 2015) provided findings about 
the impact of extended time. One study (Potter et al., 2016) yielded impact data from partici- 
pants with learning disabilities, with attention-related disabilities, or with both conditions, who 
marked their answers in test booklets versus answering on separate bubble-sheets. One study 
(Lewandowski et al., 2015) compared the performance of students without disabilities testing in 
a group administration setting with their performance in an individual small testing room. One 
study (Dong & Lucas, 2016) found impacts on student performance using various unspecified 
academic accommodations. Four of the five studies (Lewandowski et al., 2015; Lovett & Leja, 
2015; Miller et al., 2015; Potter et al., 2016) provided findings about the impact of accommo- 
dations on postsecondary students’ performance on the Nelson-Denny Reading Test (NDRT; 
Brown, Fishco, & Hanna, 1993) subtests on vocabulary and comprehension assessment, while 
one study (Dong & Lucas, 2016) presented longitudinal data on the impact of accessing or not 
accessing academic accommodations in general and their persistence in postsecondary educa- 
tion, as indicated by meeting a threshold grade point average (GPA). 
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Four studies (Cahan et al., 2016; Condra et al., 2015; DeLee, 2015; Zeedyk et al., 2016) re- 
viewed research literature that discussed accommodations in postsecondary education. Condra 
and colleagues (2015) investigated the needs and considerations of postsecondary students with 
mental health-related disabilities, highlighting a dynamic in the nature of these types of dis- 
abilities: the episodic intensity of the expression of impairments. These researchers indicated 
that some students with disabilities might need flexibility for implementing accommodations 
retroactively, based on the timing of the onset of mental health episodes of intensive stress. 
DeLee (2015) described a prominent conceptualization about accommodations focused to- 
ward student-centeredness and service provision for students with disabilities. The researcher 
recounted the challenges of accommodations selection and decision-making processes, due in 
part to the multiple and sometimes conflicting sources of information about students’ needs. She 
characterized changes in consideration for students, with an increase in valuing “assistive reading 
and listening technologies” (p. 45) and exam accommodations, and decreases in reported needs 
for such resources as recorded lectures. Zeedyk and colleagues (2015) framed considerations 
for postsecondary students with disabilities in terms of the transition from secondary to higher 
education. While addressing both social and academic needs, the current summary report pri- 
oritized these researchers’ reported findings focused on academic accommodations’ use: private 
testing room and ear plugs for minimizing intense sensory stimuli, as well as extended time for 
processing delays. Cahan and colleagues (2016) employed meta-analysis in summarizing the 
impact of extended time for students with learning disabilities; most of their findings applied to 
students in K-12 education, but they identified at least one study about postsecondary students 
[cf., Ranseen & Harris, 2005]. (See Appendix F for more detailed explanation of findings of 
each study.) 


Accommodations by Academic Content Assessments 


As in previous reports, we analyzed findings according to the academic content area that was 
the focus of each of the studies for which a content area was identified. We present findings for 
each content area according to the frequency with which the content areas were identified, with 
most prevalent content areas presented first: 12 studies in reading, 9 studies in mathematics, 4 
studies in science, 4 studies in writing, 2 studies in other language arts, and 1 study in social 
studies (see Figure 6). For each content area, we examined the impact of accommodations on 
assessment performance, perceptions about accommodations, construct validity of accommo- 
dated assessments, and implementation and use of accommodations. (See Appendix F for more 
detailed explanation of findings of each study.) 
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Figure 6. Findings by Content Areas (n=27) 
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Reading. The findings of the 12 studies in reading included those from nine studies in reading 
only (Giusto, 2015; Kim, 2016; Lewandowski et al., 2015; Lovett & Leja, 2015; Miller et al., 
2015; Potter et al., 2016; Ricci, 2015; Rudzki, 2015; Siidkamp et al., 2015) and those from three 
studies in reading and math (Cahan et al., 2016; Lin et al., 2016; Williams, 2015). The eleven 
impact studies analyzed effects on reading performance by relatively few specific accommoda- 
tions: four studies (Cahan et al., 2016; Lovett & Leja, 2015; Miller et al., 2015; Siidkamp et al., 
2015) examined extended time, two studies (Kim, 2016; Ricci, 2015) examined oral delivery, 
two studies (Lewandowski et al., 2015; Lin et al., 2016) focused on separate setting, and differ- 
ent aggregated sets of accommodations were investigated by two studies (Giusto, 2015; Rudzki, 
2015). One study (Potter et al., 2016) inquired about the impact of marking in individual test 
booklets, in comparison with answering on a separate bubble-type sheet. 


Eight of the 11 studies on accommodations effects included a comparison group of students 
without disabilities. The remaining effects studies included two with only participants with 
disabilities (Ricci, 2015; Rudzki, 2015), and one with only participants without disabilities 
(Lewandowski et al., 2015). 


Four studies engaged in other areas of investigation about accommodations. In addition to 
examining effects, Ricci (2015) also reported findings about oral delivery accommodation use 
patterns by grade 4 students with various unspecified disabilities. Lovett and Leja (2015) also 
reported findings about the perceptions of postsecondary students with disabilities. Potter and 
colleagues (2016) also reported on the construct validity issues around a response-related ac- 
commodation. Williams (2015) reported only about the perceptions of grade 8 students with 
disabilities (without examining the effects of accommodations). 
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Accommodations benefited the reading performance of at least some students with disabilities 
in two studies (Giusto, 2015; Potter et al., 2016) out of the 11 studies investigating impact on 
reading. Giusto (2015) found that an aggregated set of accommodations, oral delivery and pac- 
ing guidance by the test administrator, benefited students with reading disabilities more than 
the pacing-only and unaccommodated testing conditions; further, students without disabilities 
did not score significantly differently across these conditions. Potter and colleagues (2016) 
reported that postsecondary students with learning disabilities and/or attention-related disabili- 
ties performed better on reading tests when marking their answers in test booklets than when 
answering on separate bubble-sheets. They also indicated that this accommodation might affect 
the reading vocabulary construct. 


In contrast, most of the impact studies yielded no particular benefits for students with disabili- 
ties, especially in consideration of the accommodations’ impact on performance of students 
without disabilities. In one meta-analysis (Cahan et al., 2016) the impact of extended time on 
performance in 17 tests in 11 studies was investigated. The authors concluded that the correla- 
tion was not particularly strong for students with learning disabilities using this accommodation 
and their improvements in reading scores. 


Kim (2016) found that some participants performed better in reading comprehension when 
using in-person, rather than recorded, oral delivery, while other participants performed simi- 
larly with these two versions of the oral delivery accommodation. All participants performed 
similarly in retell quality between these accommodation conditions. This study did not have 
an unaccommodated reading test condition. Lin and colleagues (2016) indicated that students 
with disabilities had lower reading scores during testing in a separate setting than in the typical 
classroom setting. 


Lewandowski and colleagues (2015) reported that all participants—postsecondary students 
without disabilities—scored significantly better in reading with the standard group setting rather 
than the separate individual setting. Lovett and Leja (2015) found that reading performance 
was not improved with extended time for postsecondary students with attentional or executive 
functioning difficulties; in fact, students with more intensive impairments showed significantly 
less benefit. However, students with more intensive impairments perceived, more strongly than 
students with milder attention difficulties, that they needed extended time during the reading test. 
Miller and colleagues (2015) found that both postsecondary students with attentional difficulties 
and students without disabilities performed worst with standard time, better with 150% time, 
and best with 200% time. In other words, students with disabilities did not benefit differently 
than students without disabilities with extended time. Ricci (2015) indicated that students with 
disabilities using oral delivery of instructions and test items via text-to-speech performed worse 
in reading comprehension than students with disabilities using other accommodations. The re- 
searcher’s detailed provision of data for students with disabilities using various accommodations 
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highlighted the relatively lower incidence of use of text-to-speech. Analyzing an extant data set, 
Rudzki (2015) reported that students with reading disabilities performed similarly, and below 
proficiency, in reading when using an aggregated set of extended time, small group administra- 
tion, and separate setting accommodations, than students with disabilities not using this set of 
accommodations. Stidkamp and colleagues (2015) reported on reading literacy performance on 
a large-scale test in Germany, comparing data for three different testing conditions: standard 
condition, reduced test with fewer items, and simplified (1.e., modified) test with fewer items that 
were also only low in difficulty. They found that grade 5 students with disabilities completed 
more items with extended time, yet not necessarily improving scores. Using differential item 
functioning analysis, they found no items of concern for low-performing students without dis- 
abilities. However, they concluded that scoring for students with disabilities was not comparable 
or valid across all three test versions due to variance in item functioning. 


Williams (2015) reported that about 40 percent of the grade 8 participants with various dis- 
abilities indicated positive feelings, such as confidence and comfort. About 40 percent indicated 
negative feelings, such as differentiation from peers and inadequacy, about taking reading (or 
math) tests with accommodations. 


Mathematics. The nine studies with findings about mathematics included four studies in math 
only (Bouck et al., 2015; DePountis et al., 2015; Higgins et al., 2016; Weis et al., 2016), three 
studies in math and reading (Cahan et al., 2016; Lin et al., 2016; Williams, 2015), one study in 
math and science (Rosenblum & Herzberg, 2015), and one study in math and other language 
arts (Eberhart, 2015). Five studies provided findings on the impact of accommodations on math 
assessment performance (Bouck et al., 2015; Higgins et al., 2016; Lin et al., 2016; Rosenblum & 
Herzberg, 2015; Eberhart, 2015). Many of these five were experimental or quasi-experimental, 
investigating more than one accommodation condition. Most had performance data from both 
groups of students with and without disabilities. Nearly all of the impact studies—except for Lin 
et al. (2016)—also indicated student perceptions about the accommodations. In addition, three 
other studies (DePountis et al., 2015; Weis et al., 2016; Williams, 2015) reported perceptions 
about accommodations, and two studies (DePountis et al., 2015; Weis et al., 2016) provided 
findings about accommodation use or practices. 


Bouck and colleagues (2015) indicated that students with disabilities completed more test items, 
and answered more correctly, with a graphing calculator than without one. Further, student par- 
ticipants generally liked calculators, and indicated that they helped, although grade 8 students 
indicated that they did not need calculators for future testing. Cahan and colleagues (2016) used 
meta-analysis to examine the impact of extended time on 17 tests in 11 studies, concluding 
that the correlation was not particularly strong for students with learning disabilities using this 
accommodation and improvements in math scores. DePountis and colleagues (2015) reported 
that the self-reported proficiency of educators of high school students with blindness to manage 
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assistive technology was strongest in algebra and relatively strong in geometry. Many AT tools 
were identified as broadly used and at least 13 AT devices were beneficial for their students, 
such as audible calculators and electronic refreshable braille notetakers. 


Eberhart (2015) found that the overall student population performed multiple-choice items better 
on computer than tablet. She indicated that it was possible that the embedded tools were more 
difficult to work with on the smaller tablet screen, particularly when answering technology- 
enhanced items. Also, of the 10 student participants asked for their perceptions, five preferred the 
laptop, one preferred the tablet, and four liked both devices equally well; also, seven preferred 
the multiple-choice items, one preferred the technology-enhanced items, and two liked both 
items equally. Higgins and colleagues (2016) found that students who were deaf performed bet- 
ter with ASL than without signed administration, and tended to prefer the ASL features more 
similar to ASL communication patterns and more familiar to native ASL signers. 


Lin and colleagues (2016) indicated that students with disabilities performed lower with separate 
setting than in the typical classroom setting. Rosenblum and Herzberg (2015) detailed the effects 
and preferences regarding tactile graphics information that students with visual impairments 
needed for answering math (and science) test items. They noted that certain tactile formats 
were in items that students with visual impairments tended to answer more correctly. Further, 
students mostly tended to seek specific details for answering items, rather than exploring data 
images first. However, students had divergent opinions about some aspects, such as line textures. 


Weis and colleagues (2016) reported on accommodations use by postsecondary students with 
mostly learning-related disabilities, including that about 50 percent of participants used calcula- 
tors yet less than half of these students actually met criteria for using calculators in the postsec- 
ondary setting. Williams (2015) reported that about 40 percent of the grade 8 participants with 
various disabilities indicated positive feelings, such as confidence and comfort, and about 40 
percent indicated negative feelings, such as differentiation from peers and inadequacy, regarding 
taking math or reading tests with accommodations. All participants indicated that their accom- 
modations affected their assessment performance scores. In sum, the accommodation conditions 
benefited the math performance of at least some students with disabilities in four studies, and 
had a negative impact for students with disabilities in one study. Students with disabilities had 
favorable impressions of math accommodations in two studies, and shared their preferences 
about math accommodations in two studies. 


Science. The findings of the five studies in science included those from four studies in science 
only (Hansen et al., 2016; McMahon et al., 2016; Seo & Hao, 2016; Spiel et al., 2016), and those 
from one study in science and mathematics (Rosenblum & Herzberg, 2015). These findings 
included those pertaining to the usability of certain accommodations, the performance effects 
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of certain accommodations for students with and without disabilities, and scale comparability 
between non-accommodated and accommodated forms of an assessment. 


Findings from the two studies that examined usability found that students with disabilities were 
able to use all accommodations but had the most success with the tactile graphic paper-based 
static simulations (Hansen et al., 2016). When comparing tactile graphics, students had the 
most success navigating a microcapsule map (Rosenblum & Herzberg, 2015). The two studies 
that presented findings related to performance effects found that both students with and without 
disabilities had higher performance when they had a podcast-delivered science test (McMahon 
et al., 2016). Although students with ADHD had higher performance when they were provided 
with in-person oral delivery and small group accommodations, students without disabilities 
performed the same on average with or without accommodations (Spiel et al., 2016). Scale 
comparability findings reported by Seo and Hao (2016) showed that when using person-fit 
analysis (PFA) the accommodated and non-accommodated versions of a large-scale state high 
school science assessment were comparable. 


Writing. Four studies (Davis et al., 2015; Joakim, 2015; Nelson & Reynolds, 2015; Ohleyer, 
2016) provided findings related to writing. Findings pertained to the impacts of, and students’ 
preferences for, different technologies while writing and the uses and perceptions of students 
with disabilities on assistive technologies and accommodations. Enlisting general education 
participants, without specifying ability or disability status, Davis and colleagues (2015) ex- 
amined the impact of touchscreens and found that students did not vary in writing assessment 
performance based on whether they used a laptop or tablet with a touchscreen keyboard. In 
addition, they found that while few students had difficulty using touchscreens, high school 
students were more likely than grade 5 students to prefer physical keyboards over touchscreens 
for writing compositions. 


Ohleyer (2016) observed accommodations use patterns, finding that of the 7225 students with 
learning disabilities in grades 4 through 6, 59% used oral script, 12% used extended time, 8% 
used directions (only) read aloud, 2% used assistive technology, and less than 2% used scribe. 
She also examined longitudinal performance data, finding that assistive technology and admin- 
istrator-read directions most significantly improved scaled scores. Further, students who used 
assistive technology over two consecutive years were more likely to have higher growth scores 
on state assessments than students who did not use assistive technology or used assistive tech- 
nology for only one year. Joakim (2015) found that most study participants used presentation, 
timing, and setting accommodations during writing assessments. Grade 5 students not using 
accommodations scored higher than those who used accommodations, while grade 8 students 
using or not using accommodations did not score significantly differently. 
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Nelson and Reynolds (2015) found that postsecondary students thought that speech recognition 
tools made composition quicker and easier than manually typing, even though some faced initial 
challenges training the software to accurately recognize their words. Participants who were new 
speech recognition software users remarked that using this support made composing quicker 
and easier than typing (manually), and reduced the likelihood of their becoming tired early in 
the task. Two more experienced speech recognition users indicated that they performed editing 
by using the keyboard rather than by voicing edits to their computers, yet that they otherwise 
had become adept at organizing their thoughts without pre-planning or using written outlines 
or notes. 


Other Language Arts. Two studies (Eberhart, 2015; Lin & Lin, 2016) examined large scale 
data sets of testing performance on academic constructs of language arts. We did not include 
discussion of these studies’ findings as reading due to their differing content. Eberhart (2015) 
examined data from the Smarter Balanced Assessment, which she described as covering English 
language arts content, with both reading comprehension of literary and informational texts, and 
producing effective and well-grounded writing. Lin and Lin (2016) sampled from the 2012-2013 
Ontario Secondary School Literacy Test (OSSLT) data set for analysis. The OSSLT, compris- 
ing multiple-choice and constructed-response items, was administered as a requirement of high 
school graduation. Eberhart analyzed performance data from the general student population, with 
no known details about composition of students with disabilities in the population as a whole, 
while Lin and Lin performed various analyses on samples of only students with disabilities from 
of the larger extant literacy test data set. 


Eberhart (2015) found that the overall grade 7 student population performed multiple-choice 
items significantly better on computer than tablet on language arts (and math). Further, students 
on average scored higher on multiple-choice questions when using the computer than tablet; 
however, there were no significant average score differences for the technologically-enhanced 
items based on computer versus tablet. A small set of student participants were asked for their 
perceptions and preferences. Fifty percent preferred the laptop, 10 percent preferred the tablet, 
and 40 percent liked both devices equally well. Seventy percent preferred the multiple-choice 
items, 10 percent preferred the technology-enhanced items, and 20 percent liked both items 
equally. 


Lin and Lin (2016) found that the groups of students with disabilities who were provided cer- 
tain aggregated sets of accommodations, based on their IEPs, performed better than students 
with disabilities receiving either no accommodations or other accommodations. The bundles 
demonstrating the most benefit, compared to other sets, included computer administration along 
with extended time, or specialized setting, or both extended time and specialized setting. They 
highlighted that students with learning disabilities demonstrated the most significant benefit from 
these aggregated sets of accommodations. The researchers also analyzed different data adjust- 
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ment methods for addressing the problem of data sparsity. They described how the treatment 
arm correction method was found not to be useful, while the log-linear analysis and adjusted 
odds ratio method was found to be useful. 


Social Studies. One study (Seo & De Jong, 2015) provided findings about social studies assess- 
ment accommodations. Seo and De Jong (2015) analyzed a large extant data set of social studies 
assessment performance of students with and without disabilities; they did not compare subgroup 
performance patterns with one another. They found that there were no significant differences 
in group mean performance for either grade 6 or grade 9 students, between paper-based testing 
versus tests presented via computer. Differential item functioning analyses yielded that the test 
items in both presentation modes functioned similar to one another. The researchers asserted 
that the propensity score matching process they employed showed more precise datasets for 
comparison, with more equivalent comparison groups; they advocated that this research design 
was more useful for their purposes. The researchers surveyed a very small number of students 
about their preferences, and found that students preferred online testing (70%) over paper-based 
testing (10%), with 20 percent of students having no preference. None of the students indicated 
having any difficulties with the online/computer presentation format. 


Discussion 


This report provided a snapshot of accommodations research literature in 2015-2016. It ad- 
dressed the types of accommodations that were studied, the purposes of the research, the research 
type, data sources, characteristics of the independent and dependent variables under study, and 
comparability of findings between studies in similar domains—including by specific accom- 
modations and their performance effects, by academic content area, and a separate review of 
postsecondary accommodations. 


As we have found previously, mathematics and reading were the content areas most frequently 
addressed in the studies included in this analysis, although there was a relative increase in the 
number of science assessment studies. Students were the participant group in nearly two-thirds 
of the studies. Students with learning disabilities (LD) were participants in over half of the 
studies reported; indeed, they were more likely to be included in the research samples than 
other groups. Two other disability categories receiving attention by many studies were “Other 
Health Impairment” (about one-third of the studies), and students with emotional/behavioral 
disabilities (about one quarter of the studies). 


Accommodations research continues to be an area where a substantial amount of research is 
occurring. The number of studies we have located has increased across the span of NCEO’s 
reports in this area; for instance, in 2011-2012, there were 49 identified studies, in 2013-2014, 
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there were 53 studies, and now in 2015-2016, there were 58 studies. This line of research con- 
tinues to receive attention. Researchers have been exploring a wide range of topics related to 
accommodations. For instance, we continue to observe the expansion of questions and issues 
surrounding the shift from paper and pencil tests to technology-based assessments. 


Similar to previous reports (Cormier et al., 2010; Johnstone et al., 2006; Thompson et al., 2002; 
Rogers et al., 2012; Rogers et al., 2014; Rogers et al., 2016; Zenisky et al., 2007), the find- 
ings for specific accommodations were often mixed. This range of findings was demonstrated 
particularly well in the oral delivery and extended time performance impact findings. Studies 
found that oral delivery accommodations supported the performance of students with disabilities 
(Ohleyer, 2016), extended time mostly had no apparent influence (Cahan et al., 2016; Joakim, 
2015; Ohleyer, 2016), oral delivery provided no differential benefit—specifically, when pro- 
vided by an in-person reader—for students with disabilities in comparison to students without 
disabilities (McMahon et al., 2016), and oral delivery had negative impacts (Ricci, 2015). 


The findings for specific accommodations were complicated by various factors. In addition 
to the variety of ways that oral delivery can be offered to students—in-person by test proctor, 
via human voice audio- or video-recording, and delivered by computer through text-to-speech 
software—the 2015-2016 set of research findings also elucidated other factors that might limit 
positive impacts of accommodations. Student age or grade level showed variation in findings: 
participants in earlier grade levels performed better in reading comprehension with in-person 
oral delivery than recorded voice, while the older participants benefited similarly from both of 
these types of oral delivery (Kim, 2016). Also, different item types showed varying impacts 
(Eberhart, 2015), and the content area was a complicating factor, as found by Kim (2016). These 
factors served to demonstrate the ways that accommodations’ effects are highly influenced by 
circumstance, suggesting the importance of individualized assignment of accommodations as 
intended through the IEP process. 


The reauthorization of the Elementary and Secondary Education Act (ESEA) as the Every Student 
Succeeds Act (ESSA) has given states more flexibility in how they annually assess students on 
statewide tests for accountability purposes, but there is a continued focus on ensuring that the 
assessments are accessible to students with disabilities. Relatively recent and continuing issues 
related to embedded accommodations on computer-based tests, the compatibility of assistive 
technology with computer platforms, the validity of inferences, and adaptive testing will continue 
to increase as states and consortia refine their assessment systems. There will continue to be a 
need for accommodations research that addresses these complexities and other emerging issues. 
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Appendix B 


Research Characteristics 


Authors Publication | Research Research Design prose na Collection 
Type Type Source Instrument 
Ajuwon et al. (2016) Journal Qualitative | Descriptive Qualitative Primary Survey 
Barnett & Gay (2015) Journal oan Descriptive Qualitative | Secondary Articles 
Barnhill (2016) Journal Quantitative | Descriptive Quantitative Primary ake a 
Bouck et al. (2015) Journal Mixed Descriptive Quantitative Primary Survey, Test 
Cahan et al. (2016) Journal Quantitative Meta-analysis Secondary Articles 
Cawthon et al. (2015) Journal Quantitative | Correlation/Prediction Secondary eae 
Baie) Pamtiion Journal Mixed Descriptive Quantitative Primary panes hr 
Condra et al. (2015) Journal Qualitative | Descriptive Qualitative | Secondary Articles 
Couzens et al. (2015) Journal Qualitative | Descriptive Qualitative Primary Interview Protocol 
Crosby (2015) Dissertation | Qualitative | Descriptive Qualitative Primary ae 
Davis et al. (2015) Journal Mixed Quasi-Experimental Primary Survey, Test 
DeLee (2015) Journal Qualitative | Descriptive Qualitative | Secondary Articles 
eae val Journal Quantitative | Descriptive Quantitative Primary Survey 
Detrick-Grove (2016) Dissertation | Quantitative | Descriptive Quantitative Primary Survey 
Dong & Lucas (2016) Journal Quantitative Longitudinal Primary Grades 
Eberhart (2015) Dissertation Mixed Quasi-Experimental Secondary Survey, Test 
one: & Busch Journal Quantitative | Descriptive Quantitative Primary Survey 
Giusto (2015) Dissertation | Quantitative Quasi-Experimental Primary Test 
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Data Col- 


(2015b) 


Authors Publication | Research Research Design ieetion Collection In- 
Type Type Sorted strument 

Hansen et al. (2016) Journal Qualitative Descriptive Qualitative Primary se baal 

Higgins et al. (2016) Journal Mixed Descriptive Quantitative Primary peer 

Joakim (2015) Dissertation | Quantitative | Descriptive Quantitative Secondary Test 

Kafle (2015) Dissertation | Qualitative Descriptive Qualitative Primary gue esa 

Kettler (2015) Journal Qualitative Descriptive Qualitative Secondary Articles 

Kim & Lee (2016) Journal Quantitative Correlation/Prediction Secondary Grades 

Kim (2016) Journal Quantitative Quasi-Experimental Primary Test 

on ey Peventnal Journal Qualitative Descriptive Qualitative Secondary Articles 

Lawing (2015) Dissertation | Qualitative Descriptive Qualitative Primary or 

Se et al. Journal Quantitative Quasi-Experimental Primary Grades, Test 

Lin & Lin (2016) Journal Quantitative Quasi-Experimental Secondary Test 

Lin et al. (2016) Journal Quantitative Correlation/Prediction Secondary Test 

Lovett & Leja (2015) Journal Quantitative Correlation/Prediction Primary Survey, Test 

Lyman et al. (2016) Journal Qualitative Descriptive Qualitative Primary Interview Protocol 

McMahon et al. (2016) Journal Quantitative Quasi-Experimental Primary Test 

Miller et al. (2015) Journal Quantitative Quasi-Experimental Primary Survey, Test 

Monagle (2015) Dissertation | Quantitative Correlation/Prediction Primary Survey 

pares ehenolgs Journal Qualitative Descriptive Qualitative Primary Onsale es 

pai & Madauls Journal Quantitative Correlation/Prediction Secondary ke a 

plowinanise Madaus Journal Quantitative Descriptive Quantitative Secondary Interview Protocol 
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Data Col- 


uthors Publication | Research Research Design lectlon Collection In- 
Type Type Source strument 

Ofiesh et al. (2015) Journal Qualitative | Descriptive Qualitative Primary Interview Protocol 
Ohleyer (2016) Dissertation | Quantitative Longitudinal Secondary Test 
Peterson (2016) Dissertation | Qualitative | Descriptive Qualitative Primary Interview Protocol 
Potter et al. (2016) Journal Quantitative Quasi-Experimental Primary Survey, Test 
Ricci (2015) Dissertation | Quantitative Quasi-Experimental Secondary Survey, Test 
arama 15) Journal Mixed Descriptive Qualitative Primary shee Sc 
Rudzki (2015) Dissertation | Quantitative | Correlation/Prediction Secondary Test 
Ruhkamp (2015) Dissertation | Qualitative | Descriptive Qualitative Primary Survey 

Seo & De Jong (2015) Journal Quantitative Quasi-Experimental Secondary Test 

Seo & Hao (2016) Journal Quantitative | Descriptive Quantitative | Secondary Test 
Sokal (2016) Journal Qualitative | Descriptive Qualitative Primary Interview Protocol 
eoiey eels Journal Quantitative | Descriptive Quantitative Primary Observations 
Spiel et al. (2016) Journal Quantitative Quasi-Experimental Primary Test 
Sudkamp et al. (2015) Journal Quantitative | Correlation/Prediction Secondary Test 
TinMennen & Journal Qualitative Descriptive Qualitative Primary Interview Protocol 
Mulvihill (2015) 

Weis et al. (2016) Journal Quantitative | Descriptive Quantitative | Secondary Test 
Williams (2015) Dissertation | Qualitative | Descriptive Qualitative Primary Interview Protocol 
oor aon Sere Journal Qualitative Descriptive Qualitative Primary Interview Protocol 
Zambrano (2016) Dissertation | Qualitative | Descriptive Qualitative Primary Interview Protocol 
Zeedyk et al. (2016) Journal Qualitative | Descriptive Qualitative | Secondary Articles 
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Appendix C 


Instrument Characteristics 


Table C-1. Instrument Types and Specific Instruments Used, and Their Sources (n=51) 


Authors 


Ajuwon et al. 
(2016) 


Barnhill 
(2016) 


Bouck et al. 
(2015) 


Cawthon et al. 
(2015) 


Cole & 
Cawthon 
(2015) 


Couzens et al. 
(2015) 


Crosby (2015) 


NCEO 


Instrument Types and Description/s 


Researcher Test: Two surveys from other researchers, one with respondents 
from Texas, and another from across the US; data were responses for open- 
ended items, which were further open-coded into categories. 


Author Survey: Twenty-item survey with demographic items as well as items 
on other aspects of the university setting, about supports for students with 
Asperger Syndrome (AS) and autism spectrum disorder (ASD), and about 
outcomes including graduation data and support services’ features such as 
program effectiveness. 


Author Survey: Social validity survey questions using a Likert-type rating 
scale. 

Researcher Test: Twenty math assessments with eight items each (both com- 
putation and word problems); for two grade levels (grades 7 and 8), focused 
on the Common Core State Standards, drawing in part from the state assess- 
ment’s released items and other sample items; measured the number of correct 
responses and the number of items attempted. 

Norm-ref Ach: Calculation subtest and Writing Fluency subtest of the Wood- 
cock Johnson III Tests of Achievement (W4J-III; Woodcock, McGrew, & Mather, 
2001a); Written Expression subtest of the Wechsler Individual Achievement 
Test-Second Edition (WIAT-II; Wechsler, 2001). 


Researcher Test: Used extant data set from a separate larger data set about 
students (NLTS2), including demographic information, incidence of accommo- 
dations use, and persistence in postsecondary education; data had been col- 
lected from parents and school personnel, through phone interviews or paper 
surveys. 


Author Survey: Student self-report survey asking for demographic information 
such as GPA, major, type of learning disabilities, along with students’ accom- 
modations use and disclosure about disabilities; semi-structured interview of 
postsecondary students about the factors they identified influencing self-disclo- 
sure. 

Researcher Test: The Self-Determination Scale (SDS; Sheldon & Deci, 1993), 
the Revised Self-Disclosure Scale (RSDS; Wheelees, 1978), and the Attitudes 
Toward Requesting Accommodations scale (ATRA; Barnard-Brak, Davis, Tate, 
& Sulak, 2009). 


Author Survey: Semi-structured interviews of both postsecondary students 
and staff members; students were asked about learning strengths and chal- 
lenges, accessing formal disability services, and support experiences including 
their perceptions of least useful supports; staff members were asked about the 
needs of students with learning difficulties, and aspects of supporting these 
students. 


Author Survey: Survey of faculty members about perceptions of disability, as 
well as their knowledge of accommodations, and practices providing accom- 
modations; also, semi-structured interview protocol, asking postsecondary 
students about their experiences with their disabilities and requesting accom- 
modations. 

Other: Other document analysis (for data triangulation), including academic 
records (i.e., grades) and disability documentation. 


Total 


61 


Authors 


DePountis et 
al. (2015) 


Detrick-Grove 
(2016) 


Dong & Lucas 
(2016) 


Eberhart 
(2015) 


Gallego & 
Busch (2015) 


Giusto (2015) 


Hansen et al. 
(2016) 


Higgins et al. 
(2016) 


Joakim (2015) | State Test: New England Common Assessment Program (NECAP) 2012 writ- 
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Instrument Types and Description/s Total 


Author Survey: Survey that included items about demographic and teaching 
experience information as well as teachers’ perspectives including their self- 1 
perceptions about proficiencies with several assistive technology devices. 

Author Survey: This study was a replication of a study completed by Brown 
(2007), and the researcher documented the adjustments made to the original 


survey for the current study. The focus of the survey was to gather educators’ A 
perspectives about accommodations, including their knowledge about them. 

Author Survey: Survey of 200 items designed by researchers covering basic 
demographics, including students’ self-reported disabilities, as well as their aca- 4 


demic grades and progress toward postsecondary degrees, and documenting 
patterns of seeking accommodations. 


Author Survey: Student self-report questionnaire, requesting their experience 
and perspectives on testing format. Structured “think-aloud” cognitive laboratory 
interview form for documenting interviewer observations, along with interview 
transcripts. 2 
Researcher Test: KITE computerized assessment system, used by the state to 
measure performance in English language arts and mathematics, based on the 
Smarter Balanced Assessment Consortium’s item/task specifications. 


Author Survey: Educator surveys requesting respondents’ perspectives about 
accommodations and their observations about how accommodations are pro- 1 
vided, including rating scale responses. 


Norm-ref Ach: Primary achievement test: Gates-MacGinitie Reading Compre- 
hension Tests, 4th Edition, Reading Comprehension Subtest, Form S—Grade 

3 (MacGinitie, MacGinitie, Maria & Dreyer, 2000); also, for screening/identifi- 
cation: Woodcock Reading-Mastery Test-Revised (WRMT-R) Word Reading 
Subtest (Woodcock, 1987); WRMT-R Word Attack Subtest (Woodcock, 1987). 
Norm-ref Ability: For screening/identification: Clinical Evaluation of Language 
Functions, Fourth Edition (CELF-4) Understanding Concepts and Spoken 
Directions Subtest (Semel, Wiig, & Secord, 2003); CELF-4 Understanding Spo- 
ken Paragraphs Subtest (Semel et al., 2003); Peabody Picture Vocabulary Test, 
Fourth Edition (PPVT-IV; Dunn & Dunn, 2007). 


Author Survey: Structured interview protocol: pre-session included demo- 
graphic information and details about prior experience with assistive technolo- 
gy, and post-session included gathering information about testing experiences; 
researcher observation form. 

Other: Science assessment task based on Next Generation Science Stan- 
dards; checked the four test conditions with the W3C Web Content Accessibility 
Guidelines (Caldwell, Cooper, Reid, & Vanderheiden, 2008). 


Author Survey: Survey from teachers rating students’ reading levels; struc- 
tured “think-aloud” cognitive laboratory interview protocol for documenting 
interviewer observations. 

State Test: Mathematics test items were compiled from states’ and consortia’s 
released test items, including various item types requiring different response 
formats from students. 


ing test scores. 


NCEO 


Authors Instrument Types and Description/s Total 


Author Survey: Structured interview protocols, involving both the disability 
support program coordinator and postsecondary students as participants, 
asking about learning disabilities, disclosing disabilities to instructors, instruc- 
tors’ perceptions as experienced, and requesting and provision of support and 
accommodations. 

Other: Other artifacts examined—provided by students—included students’ 
academic records (i.e., grades), diagnostic and medical assessments, and dis- 
ability support program records of services used by students. 


Kafle (2015) 


Author Survey: Semi-structured interviews of both postsecondary students 
and staff members; students were asked about learning strengths and chal- 
lenges, accessing formal disability services, and support experiences including 
their perceptions of least useful supports; staff members were asked about the 
needs of students with learning difficulties, and aspects of supporting these 
students. 


Kim (2016) 


Other: Postsecondary cumulative grade point averages (GPAs) were reported, 
Kim & Lee as an indicator of both relative academic success and persistence; research- 
(2016) ers noted that other factors were also acknowledged as having likely influenced 
participants’ GPAs. 


Author Survey: Attitudes Towards Teaching All Students (ATTAS-mm), a nine- 
item teacher rating survey (researcher designed) about inclusion; interview 
protocol to expand upon survey responses. 

Lawing (2015) | Researcher Test: Two selected items from the Alabama Accommodations Sur- 2 
vey, a 13-item survey of accommodations decision-making, from the Alabama 
Department of Education and the National Center on Educational Outcomes 
(NCEO; Altman et al., 2010). 


Author Survey: Demographic survey, and grade point average (GPA). 


Lewandowski 


Norm-ref Ach: Nelson-Denny Reading Test (Brown et al., 1993) Forms G and 2 
et al. (2015) 
H, subtest on reading comprehension. 
Lin et al. State Test: Province of Ontario (Canada) Junior (grade 6) Assessment of 1 
(2016) Reading, Writing, and Mathematics, 2005-2006. 
Lin & Lin State Test: Ontario Secondary School Literacy Test (OSSLT), grade 10, 2012- 1 
(2016) 2013. 
Lovett & Leja | Norm-ref Ach: Nelson-Denny Reading Test (NDRT; Brown et al., 1993) Form 
(2015) H comprehension subtest. Screening and correlation: reading fluency subtest, 
Woodcock-Johnson Tests of Achievement, Third Edition (WJ-III; Woodcock et 
al., 2001). 
Norm-ref Ability: Screening and correlation—processing speed subtests from 
the Wechsler Adult Intelligence Scale, Third Edition (WAIS-III; Wechsler, 1997). 
Other: Screening and correlation—Self-Evaluation of Performance on Timed 
Academic Reading (SEPTAR; Kleinmann, 2005); ADHD current symptoms 
scale from Behavior Rating Inventory of Executive Functioning (BRIEF-A; Roth, 
Isquith, & Gioia, 2005). 
Lymanetal. | Author Survey: Semi-structured interview protocol, asking postsecondary stu- 1 
(2016) dents about their disabilities, learning experiences, and accommodations from 
disability support services. 
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Authors 


McMahon et 
al. (2016) 


Miller et al. 
(2015) 


Monagle 
(2015) 


Nelson & 
Reynolds 
(2015) 


Newman 
& Madaus 
(2015a) 


Ofiesh et al. 
(2015) 


Peterson 
(2016) 


Potter et al. 
(2016) 


64 


Instrument Types and Description/s 


Researcher Test: Three versions of a 30-item end-of-year science perfor- 
mance assessment developed by the researchers; they checked the reading 
level of the content using the Flesch-Kincaid readability formula (Kincaid, Fish- 
burne, Rogers, & Chissom, 1975). 


Norm-ref Ach: Nelson-Denny Reading Test (Brown et al., 1993) Forms G and 
H, subtest on reading comprehension. 


Author Survey: Survey included items on demographics and accommodations 
use information, and also students’ attitudes toward requesting accommoda- 
tions, based on Attitudes Toward Requesting Accommodations scale (ATRA; 
Barnard-Brak, Davis, Tate, & Sulak, 2009). 


Author Survey: Interview protocol inquiring about postsecondary students’ 
writing experiences, processes, and attitudes, as well as speech recognition 
experiences; researchers’ observation notes of composition sessions. 
Researcher Test: Examination of written products from speech recognition- 
supported composition sessions using quality indicators including both a holistic 
evaluation of the compositions as well as accounting issues like spelling, vo- 
cabulary use, and errors. 


Researcher Test: Extant data from larger data set about students—National 
Longitudinal Transition Study—2 (NLTS2; Valdes et al., 2013); included demo- 
graphics such as disability categories, and also high school GPA. Also included 
a subset of survey item data from the Arc’s Self-Determination Scale subscales 
on self-realization, psychological empowerment, and personal autonomy 
(Wehmeyer, 2000). The NLTS2 data set was originally collected from students’ 
parents and school personnel, through phone interviews or paper surveys. 


Researcher Test: Extant data from larger data set about students--National 
Longitudinal Transition Study—2 (NLTS2; Valdes, Godard, Williamson, McCrack- 
en, & Jones, 2013); included demographic information, postsecondary enroll- 
ment, and incidence of accommodations and supports use. The NLTS2 data set 
was originally collected from students’ parents and school personnel, through 
phone interviews or paper surveys. 


Author Survey: Structured focus group protocol for multiple participant groups, 


asking postsecondary students with attention-related disabilities about their 
experiences taking course exams, including accommodations use. 


State Test: Extant data set from Colorado Student Assessment Program 
(CSAP; CTB/McGraw-Hill, 2009) grades 4, 5, & 6 in writing. 


Author Survey: Semi-structured interview protocol inquiring about postsecond- 
ary disabilities services managers’ experiences providing assistive technology 
supports to students with disabilities, including successes and challenges. 


Author Survey: Demographic questionnaire and self-reported grade point 
average, their perceived reading ability, and their preference between the two 
testing conditions (with or without accommodation). 

Norm-ref Ach: Nelson-Denny Reading Test (Brown et al., 1993) Forms G and 
H, subtest on vocabulary; both number of items completed and number of items 
correct were documented. 

Norm-ref Ability: Wechsler Intelligence Scale for Children (WISC-IV; Wechsler, 
2003) and Woodcock-Johnson Tests of Cognitive Abilities II] (WJIII COG; 
Woodcock, McGrew, & Mather, 2001b). 


Total 


NCEO 


Authors 


Ricci (2015) 


Rosenblum 
& Herzberg 
(2015) 


Rudzki (2015) 


Ruhkamp 
(2015) 


Seo & De 
Jong (2015) 


Seo & Hao 
(2016) 


Sokal (2016) 


Spenceley 
& Wheeler 
(2016) 


Speil et al. 
(2016) 


NCEO 


Instrument Types and Description/s 


Norm-ref Ach: Extant data set for the National Assessment of Educational 
Progress (NAEP) reading assessment (2011) from three states (Connecticut, 
New Jersey, & New York), comprehension of informational and literary texts; 
included data from the NAEP Students with Disabilities/English language learn- 
ers Questionnaire, completed by educators about each assessed student. 


Author Survey: Structured interview protocol about recent experiences with 
tactile graphics, as well as about previous use of tactile graphics and braille; 
parents reported students’ demographic data. 

Researcher Test: Set of objective questions after having examined four differ- 
ent tactile graphic representations typically used for math and science content; 
performance on items was documented. 


Author Survey: District demographic data records. 

State Test: Extant data set of one district’s students with reading disabilities in 
grades 3 through 8 (unspecified) state reading assessment performance scores 
for fall 2012. 


Author Survey: Student self-report survey, requesting demographic data and 
perceptions about accommodations; interview protocol. 


State Test: A subset of state assessment data from 222 volunteer schools, 
including the 2012 Michigan Educational Assessment Program scores in social 
studies. 


State Test: Selected extant data—responses from 2010 Michigan Merit Exami- 
nation grade 11 science (biological sciences, earth/space sciences, physics, 
and chemistry); also comprised a subset of science test items from the Ameri- 
can College Test (ACT). 


Author Survey: Interview protocol, asking postsecondary accessibility services 
professionals and faculty about providing accommodations and other support- 
ive assistance for students with the mental health concern of anxiety. 


Author Survey: Records of postsecondary students with disabilities, including 
demographic data and documentation of time used for course exams at Disabil- 
ity Support Services (DSS) office. 


Researcher Test: 20-item science tests, with multiple-choice and short-answer 
items, for grades 4, 5, 6, & 7 students. 

Norm-ref Ach: Wechsler Individualized Achievement Test-Third Edition (WIAT- 
Ill; Wechsler, 2009). 

Norm-ref Ability: Screening—Wechsler Abbreviated Scale of Intelligence-Sec- 
ond Edition (WASI-II; Wechsler, 2011). 

Other: Screening/diagnostics—Children’s Interview for Psychiatric Syndromes- 
Parent Version (P-ChIPS; Weller, Weller, Fristad, Rooney, & Schecter, 2000), 
Disruptive Behavior Disorder Rating Scale-Parent Version (DBD; Pelham, 
Gnagy, Greenslade, & Milich, 1992), and Impairment Rating Scale-Parent Ver- 
sion (IRS; Fabiano et al., 2006). 


Total 


65 


Authors 


Stdkamp et 
al. (2015) 


Timmerman 
& Mulvihill 
(2015) 


Weis et al. 
(2016) 


Williams 
(2015) 


Yssel et al. 
(2016) 


Zambrano 
(2016) 


Instrument Types and Description/s 


Researcher Test: Three extant data samples of grade 5 students from a larger 
longitudinal data set about students (German National Educational Panel 
Study/NEPS), including demographics and performance in reading literacy. 


Author Survey: Semi-structured interview protocol, asking postsecondary stu- 
dents with disabilities about their accommodations experiences. 


Author Survey: Records of postsecondary students with learning disabilities, 
including accommodations use. 

Other: Redacted (de-identified) data provided to the researchers included 
unspecified achievement and cognitive testing resulting in diagnostics (applying 
the Diagnostic and Statistical Manual of Mental Disorders, DSM III-R and DSM 
IV) and yielding academic accommodations and/or modifications recommended 
for the students by clinicians, along with disabilities histories and accommoda- 
tions provided during past schooling. 

Author Survey: Semi-structured interview protocol, asking middle school 
students about their assessment accommodations experiences; also, education 
records for triangulation purposes. 


Author Survey: Semi-structured interview protocol inquiring about the experi- 
ences of postsecondary students and their disabilities, their learning experi- 
ences, and how they perceived the accommodations they were provided. 


Author Survey: Semi-structured interview protocol, asking postsecondary stu- 
dents about their disabilities, their learning experiences; also, asking students 
and one disability resource services professional about accommodations. 


Total 


1 


Note. An additional seven studies (Barnett & Gay, 2015; Cahan et al., 2016; Condra et al., 2015; DeLee, 2015; 
Kettler, 2015; Lane & Leventhal, 2015; Zeedyk et al., 2016) were literature reviews, and did not use data collec- 


tion instruments. 


KEY: 


Instrument Types 


Non-Academic Protocols or Surveys Developed by Study 


Author/s 


Surveys or Academic Tests Developed by Professionals or 
Researchers through Work Outside of Current Study 


State Criterion-referenced Assessment 
Norm-referenced Academic Achievement Measures 
Norm-referenced Cognitive Ability Measures 


Other 
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Author Survey 


State Test 
Norm-ref Ach 


Norm-ref Ability 
a 


Researcher Test | ae | 


raer, Number of 
Type Abbreviations 


3 
1 


3 

3 
5 
7 
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Table C-2. Content Areas Assessed 


Authors 


Math 


Reading 


Writing 


Other LA 


Science 


Social Studies 


Bouck et al. (2015) 


e 


Davis et al. (2015) 


Eberhart (2015) 


ea 


Giusto (2015) 


Hansen et al. (2016) 


Higgins et al. (2016) 


Joakim (2015) 


Kim (2016) 


Lewandowski et al. (2015) 
Lin, Childs, & Lin (2016) 


Lin & Lin (2016) 


eb 


Lovett & Leja (2015) 


McMahon et al. (2016) 


Miller et al. (2015) 


Nelson & Reynolds (2015) 


Ohleyer (2016) 


Potter et al. (2016) 


Ricci (2015) 


Rosenblum & Herzberg (2015) 


Rudzki (2015) 


Seo & De Jong (2015) 
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c) 

=) 

Authors 2 D Ss g | o 

so = 5 © & 

8 = = 2 ou 

= o Ss re) ” vy 2 z 
Seo & Hao (2016) ° 1 
Spiel et al. (2016) ° 1 
Stdkamp et al. (2015) ° 1 
TOTAL 4 10 4 2 4 1 27 


Note. This table encompasses the subset of studies (n=24) which used assessments or tests on academic con- 
tent area/s or cognitive skills; studies that were excluded used surveys or other data collection mechanisms only. 


@|n this study, other LA = identified by Smarter Balanced Assessment as English language arts, with both reading 
comprehension of literary and informational texts, and writing—producing effective and well-grounded writing. 


> In this study, other LA = the Canadian province’s literacy test, a requirement of high school graduation. 


68 


NCEO 


Appendix D 


Participant and Sample Characteristics 


; Percent of F Disability Types 
Author/s Obit oF Sample Sample with Grade. Education Included in 
Analysis Size Pa aieane Level 
Disabilities Sample 


Ajuwon et al. (2016 2 0% 


) [27 

Barnett & Gay (2015) [WA | _NA_| NIA 

Barnhil (2016) [Educators | 90 | 0% 
[WAN 


Bouck et al. (2015) Students 100% Grades 7 & 8 AP, A, EBD, LD 
Gahan etal. (2016) NIA 
) 


Cawthon et al. (2015) | Students 210 100% Middle er nigh HI, Mult. 
school; ages 13-18 
Students 100% Postsecondary 


N/A N/A 


Postsecondary 
3 students; no age 
ae (Disability Services He 
personnel) 


Crosby (2015) sual 4% Postsecondary AP, EBD, LD, PD 


Cole & Cawthon 
(2015) 


Condra et al. (2015 


Students, 


Couzens et al. (2015) Educators 


DeLee (2016 NA 


0% 


Davis et al. (2015) Students 8 0% Sr pe clades. ae 
) 
DePountis et al. 
Detrick-Grove (2016) 2 
AP, EBD, LD, ID 
re} ’ ’ ’ ’ 
Dong & Lucas (2016) | Students 8905 8% Postsecondary 
Eberhart 075) [Students | 38010 0% 
Gallego & Busch . 
Giusto (2018) Students | 82 | 34% 
er Grades 3-5, Grades 
0 , 
Higgins et al. (2016) Students 100% 6-8, Grades 9-12 
) 
) 


4 
N 
3 
N 
3 
1 
8 


Hansen et al. (2016) | Students 100% Grades 8-9 Vi 
A, EBD, HI, LD 
fe} ’ , ’ ’ 
Joakim (2015 Students 100% Grades 5 & 8 ID, PD, S/L, Mult. 
Kafle (2015) Students | 8 | 100% Postsecondary 
NIA 


7 
/A 
0 

7 
/A 

1 
/A 
5 

90 
26 
/A 
22 
67 
22 
2 

3 

79 
56 
/A 


Kettler (2015 
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: Percent of ; Disability Types 
Author/s : , Sample with Gradey Education Included in 
: MES Level 
Disabilities Sample 


AP, A, EBD, HI, 
Kim & Lee (2016) Students 1055 100% Postsecondary LD, PD, S/L, VI, 
Mult. 
Kindergarten, Grade 
Kim (2016) Students ef is bs 2, & Grade 4 LD, S/L, None 
Lane & Leventhal 
(2015) 


vawing 075) mame [ OE fig 


Lin & Lin (2016) Students 14499 100% Grade 10 EBD, LD, Mult. 


Lovett & Leja (2015) | Students Postsecondary 


Lyman et al. (2016) Students 100% Postsecondary ag ore EP 


McMahon et al. (2076) | Students 
Miller et al. (2015) Students oe Postsecondary 


AP, A, EBD, LD 
(0) , , , , 
Monagle (2015) Students | 288 | 00% Postsecondary PD, Mult. 
Nelson & Reynolds Students | os 00% Postsecondary AP, EBD, LD, PD 


Newman & Madaus AP, A, EBD, HI, 
Students 2470 00% Postsecondary LD, ID, PD, S/L, 
sis VI, Mult. 
AP, A, EBD, HI, 
Newman ee Madaus. | Students 3190 Postsecondary LD, ID, PD, SI/L, 
pia VI, Mult. 


Postsecondary AP, LD 


Potter et al. (2016) Students 101 25% Postsecondary ies MUI 
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Author/s Unit or. 
Analysis 

Rosenblum & Herz- 

berg (2015) Students 

Rudzki (2015) Students 


Seo & Hao (2016) Students 19788 
Sokal (2076) 


Spenceley & Wheeler 
(2016) Students 1093 
Spiel et al. (2016) Students 


Stdkamp et al. (2015) | Students 6341 


Timmerman & Mulvi- 

hill (2015) see 
Weis et al. (2016) Students 
Williams (2015) Students 
Yssel et al. (2016) Students 


Zambrano (2016) Students 


Zeedyk et al. (2016) 


AP: Attention Problem 

A: Autism 

EBD: Emotional/Behavioral Disability 
HI: Hearing Impairment/Deafness 
ID: Intellectual Disability 

LD: Learning Disability 

PD: Physical Disability 

S/L: Speech/Language Disability 
TBI: Traumatic Brain Injury 

V/|: Visual Impairment/Blindness 
Mult: Multiple Disabilities 

None: Students without Disabilities 


NCEO 


Percent of 
Sample with 
Disabilities 


100% 
5.8% 


missing 
0% 


100% 
44% 
7% 
100% 
100% 
100% 
100% 
0% 
N/A 


Disability Types 
Included in 
Sample 


Grade / Education 
Level 


Grades 6, 7, 8, 9, 
10, 11, & 12 (at least 
one or more in each 
grade) 


Grades 3-8 (but 
grade level of each 

0 LD 
participant was not 
specified) 


Postsecondary Not Specified 


Grades 6 & 9 Not Specified 
None 


Postsecondar And EBD ED: 
y PD, VI, Mult. 
Grades 4,5,6,&7  |AP, EBD, LD, 
(ages 9 to 14) Mult., None 
Postsecondary AP, A, LD, VI 
Postsecondar ACE EBE Le, 
y S/L, Mult. 
AP, A, LD, ID, 
AP, LD, PD, VI, 


Postsecondary AP, EBD, LD, PD 
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Appendix E 


Accommodations Studied 
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Table E-2. Equipment Accommodations Itemized by Study 


Author/s 


Cawthon et al. (2015) 
Davis et al. (2015) 
Eberhart (2015) 
Hansen et al. (2016) 
Kettler (2015) 

Kim & Lee (2016) 

Lin & Lin (2016) 
McMahon et al. (2016) 
Ohleyer (2016) 

Ricci (2015) 

Seo & De Jong (2015) 
Seo & Hao (2016) 
Weis et al. (2016) 
TOTAL 


NCEO 


Pre-recorded hu- 


man voice player/ 


device 


Computer adminis- 


tration 


Technological aid 


TOTAL 


yO} =a/ =), /—_ /—2 / rp], )/rm]/rM] nm] al = 


= 
© 


15 
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Table E-4. Scheduling Accommodations Itemized by Study 


Author/s 


Extended 


time 


Multiple 
day 


Test 


breaks 


Barnett & Gay (2015) 


Barnhill (2016) 


Cahan et al. (2016) 


Cawthon et al. (2015) 


Joakim (2015) 


Kettler (2015) 


Kim & Lee (2016) 


Lin & Lin (2016) 


Lovett & Leja (2015) 


Miller et al. (2015) 


Ofiesh et al. (2015) 


Ohleyer (2016) 


Rudzki (2015) 


Ruhkamp (2015) 


Spenceley & Wheeler (2016) 


Sudkamp et al. (2015) 


Timmerman & Mulvihill (2015) 


Weis et al. (2016) 


Williams (2015) 


Yssel et al. (2016) 


Zambrano (2016) 


Zeedyk et al. (2016) 


TOTAL 


22 


N 
o 
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Table E-5. Setting Accommodations Itemized by Study 


Author/s 


Barnett & Gay (2015) 


Individual 


Small 


group 


Specialized 
setting 


TOTAL 


Barnhill (2016) 


Cawthon et al. (2015) 


Joakim (2015) 


Kettler (2015) 


Kim & Lee (2016) 


Lin et al. (2016) 


Lin & Lin (2016) 


Rudzki (2015) 
Ruhkamp (2015) 


SN ee ee ee ee 


Williams (2015) 


Yssel et al. (2016) 


Zambrano (2016) 


Zeedyk et al. (2016) 


|=aieaia/m/a/rnm/=/=/al/ol;n/] alas] =a 


TOTAL 


12 


= 
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